Malfreemaps Mirror Project

Organize, plan, exchange ideas, debate our mapping project.

Moderators: Moderators, Regional Mappers

Forum rules
1. Be nice to each other and respect the moderators. Post in normal font size, color and weight. Follow Nettiquette
2. NO out of topic. Discuss about current MFM projects or propose new projects only.
3. NO abuse, profanity and insults
4. NO spamming, cross posting and opening of duplicate topics
5. NO advertisement post or link
6. NO post/link to warez, cracks, serials or illegally obtained copyrighted content
7. Each message posted is owned by and is the opinion of the original poster. Neither mfm nor its owner or moderators are legally responsible for anything posted on the forum
User avatar
feiming
Valued Contributor
Posts: 180
Joined: Tue Feb 03, 2009 4:45 pm
Location: Bukit Beruang,Batu Anam
Contact:

Malfreemaps Mirror Project

Postby feiming » Thu Oct 29, 2009 1:01 pm

Objective:To create a better/faster/easier distribution of updates between MFM and mirrors.The ACL are to prevent hotlinking.

How to Start: Mirror participants are required to register the mirror's ip address/domain in order to gain access to the server.

Directory:
/mirror
/mirror/latest
/mirror/Garmin
/mirror/Magellan
/mirror/Papago

Mirroring with WGET

Code: Select all

wget -nH -mk www.malfreemaps.net/mirror

only mirror latest files

Code: Select all

wget -nH -mk www.malfreemaps.net/mirror/latest



Wget is unix based (Linux/BSD/Solaris) non-interactive network downloader.

Code: Select all

-nH
       --no-host-directories
           Disable generation of host-prefixed directories.  By default,
           invoking Wget with -r http://fly.srk.fer.hr/ will create a struc-
           ture of directories beginning with fly.srk.fer.hr/.  This option
           disables such behavior.
           Example:
                      No options         -> www.malfreemaps.net/mirror/Garmin
                      -nH                    -> mirror/Garmin
                      -nH --cut-dirs=1  -> Garmin/
                      -nH --cut-dirs=2  -> .

-m
       --mirror
           Turn on options suitable for mirroring.  This option turns on
           recursion and time-stamping, sets infinite recursion depth and
           keeps FTP directory listings.  It is currently equivalent to -r -N
           -l inf --no-remove-listing.

 -k
       --convert-links
           After the download is complete, convert the links in the document
           to make them suitable for local viewing.  This affects not only the
           visible hyperlinks, but any part of the document that links to
           external content, such as embedded images, links to style sheets,
           hyperlinks to non-HTML content, etc.

-R rejlist
           --reject rejlist
           Specify comma-separated lists of file name suffixes or patterns to
           accept or reject. Note that if any of the wildcard characters, *,
           ?, [ or ], appear in an element of acclist or rejlist, it will be
           treated as a pattern, rather than a suffix.
           Example:
                      -R index.html                      -> do not download index.html
                      -R index.html,otherfile.txt     -> do not download index.html and otherfile.txt

       --user=user
       --password=password
           Specify the username user and password password for both FTP and
           HTTP file retrieval.  These parameters can be overridden using the
           --ftp-user and --ftp-password options for FTP connections and the
           --http-user and --http-password options for HTTP connections.

[/code]
Last edited by feiming on Thu Nov 05, 2009 10:06 am, edited 6 times in total.

User avatar
feiming
Valued Contributor
Posts: 180
Joined: Tue Feb 03, 2009 4:45 pm
Location: Bukit Beruang,Batu Anam
Contact:

Re: Malfreemaps Mirror Project

Postby feiming » Thu Oct 29, 2009 1:02 pm

LIST OF MIRRORS
http://oss.mmu.edu.my/pub/map/ (sync daily at 12pm)
Last edited by feiming on Thu Oct 29, 2009 6:10 pm, edited 2 times in total.

User avatar
nyem
Valued Contributor
Posts: 164
Joined: Wed Sep 17, 2008 2:09 am
Location: Here
Contact:

Re: Malfreemaps Mirror Project

Postby nyem » Thu Oct 29, 2009 1:32 pm

feiming wrote:Mirroring with WGET

Code: Select all

wget -nH -mk www.malfreemaps.net/mirror

Can you explain what this code means and how to use it?
http://flavors.me/nyem

User avatar
feiming
Valued Contributor
Posts: 180
Joined: Tue Feb 03, 2009 4:45 pm
Location: Bukit Beruang,Batu Anam
Contact:

Re: Malfreemaps Mirror Project

Postby feiming » Thu Oct 29, 2009 2:40 pm

nyem wrote:
feiming wrote:Mirroring with WGET

Code: Select all

wget -nH -mk www.malfreemaps.net/mirror

Can you explain what this code means and how to use it?

Wget is unix based (Linux/BSD/Solaris) non-interactive network downloader.

Code: Select all

-nH
       --no-host-directories
           Disable generation of host-prefixed directories.  By default,
           invoking Wget with -r http://fly.srk.fer.hr/ will create a struc-
           ture of directories beginning with fly.srk.fer.hr/.  This option
           disables such behavior.
-m
       --mirror
           Turn on options suitable for mirroring.  This option turns on
           recursion and time-stamping, sets infinite recursion depth and
           keeps FTP directory listings.  It is currently equivalent to -r -N
           -l inf --no-remove-listing.

 -k
       --convert-links
           After the download is complete, convert the links in the document
           to make them suitable for local viewing.  This affects not only the
           visible hyperlinks, but any part of the document that links to
           external content, such as embedded images, links to style sheets,
           hyperlinks to non-HTML content, etc.

User avatar
nyem
Valued Contributor
Posts: 164
Joined: Wed Sep 17, 2008 2:09 am
Location: Here
Contact:

Re: Malfreemaps Mirror Project

Postby nyem » Thu Oct 29, 2009 4:16 pm

feiming wrote:Wget is unix based (Linux/BSD/Solaris) non-interactive network downloader.

So what does this means?

Code: Select all

--15:54:55--  http://www.malfreemaps.net/mirror
           => `mirror'
Resolving www.malfreemaps.net... 119.110.99.115
Connecting to www.malfreemaps.net|119.110.99.115|:80... connected.
HTTP request sent, awaiting response... 403 Forbidden
15:54:55 ERROR 403: Forbidden.
http://flavors.me/nyem

User avatar
feiming
Valued Contributor
Posts: 180
Joined: Tue Feb 03, 2009 4:45 pm
Location: Bukit Beruang,Batu Anam
Contact:

Re: Malfreemaps Mirror Project

Postby feiming » Thu Oct 29, 2009 4:35 pm

nyem wrote:
feiming wrote:Wget is unix based (Linux/BSD/Solaris) non-interactive network downloader.

So what does this means?

Code: Select all

--15:54:55--  http://www.malfreemaps.net/mirror
           => `mirror'
Resolving www.malfreemaps.net... 119.110.99.115
Connecting to www.malfreemaps.net|119.110.99.115|:80... connected.
HTTP request sent, awaiting response... 403 Forbidden
15:54:55 ERROR 403: Forbidden.

it means that your forbidden to download because htaccess blocks.Can i have your server IP address to include it in the access list?

chaicka
Polygon Mapper
Posts: 358
Joined: Thu Mar 12, 2009 2:54 pm

Re: Malfreemaps Mirror Project

Postby chaicka » Sun Nov 01, 2009 9:33 pm

I don't think we are allowed to run non-standard executable on co-hosting services that we don't own.

I would be great if MFM main can run rsync and the mirrors can use rsync (standard on most, if not all, shared/co-hosting services).

User avatar
feiming
Valued Contributor
Posts: 180
Joined: Tue Feb 03, 2009 4:45 pm
Location: Bukit Beruang,Batu Anam
Contact:

Re: Malfreemaps Mirror Project

Postby feiming » Sun Nov 01, 2009 11:39 pm

chaicka wrote:I don't think we are allowed to run non-standard executable on co-hosting services that we don't own.

I would be great if MFM main can run rsync and the mirrors can use rsync (standard on most, if not all, shared/co-hosting services).

I thought of rsync,but i doubt MFM server could do so.Unless MFM were to get a dedicated server.

User avatar
fauzee
Polygon Mapper
Posts: 1243
Joined: Fri Feb 06, 2009 9:19 pm
Location: JB and Muar -200W & 60Csx

Re: Malfreemaps Mirror Project

Postby fauzee » Mon Nov 02, 2009 12:02 am

hope i can download using this mirror tomorrow....our main download quite slow and getting 2-3 hour to done.. ](*,) ](*,)
~Lost Is Nothing~
...PLEASE INSTALL THE LATEST MAPS BEFORE DOIN' SOMETHIN'...

User avatar
fruitplus
Polygon Mapper
Posts: 1425
Joined: Sat Jan 24, 2009 3:35 pm
Location: On The Road
Contact:

Re: Malfreemaps Mirror Project

Postby fruitplus » Mon Nov 02, 2009 1:25 am

fauzee wrote:hope i can download using this mirror tomorrow....our main download quite slow and getting 2-3 hour to done.. ](*,) ](*,)

Ya kah Fauzee?
Not using Internet Download Manager ka?
My download finish not more than half an hour..if line fast, it will finish within 10-15mins..
Past + Present = Future


Return to “Project Room”

Who is online

Users browsing this forum: No registered users and 3 guests