[OSM-talk] Wiki Offline Copy?
Grant Slater
openstreetmap at firefishy.com
Mon Nov 10 14:43:43 GMT 2008
Alexander Menk wrote:
> Hi!
>
> maybe a good intermediate solution would be to provide zipped "wget -r"
> copies of the wiki? Of course not everybody shall do "wget -r
> wiki.openstreetmap.org" because this would cause to much load, but I
> could offer some webspace and do weekly snapshots or s.th. like this?
>
Dude! No no no.
~23100 pages x multiple page views x all history x special page links =
big scary number. Do not do it.
Bots are causing most of the load problems on the wiki, do not start
another one.
> Unfortunately wget is excluded by robots.txt, that's why I ask before I
> do so..
>
Yes, wget is blocked for good reason. Wikipedia blocks it too.
The server which runs the wiki will be upgraded soon. If the community
then agrees, we could setup a weekly data dump. Something like:
http://meta.wikimedia.org/wiki/Data_dumps
/ Grant
More information about the talk
mailing list