[OSM-dev] Google doesn't find new wiki urls

[Ævar Arnfjörð Bjarmason]

On Wed, Jan 14, 2009 at 10:36 AM, Tom Hughes <tom at compton.nu> wrote:
> Erik Johansson wrote:
>> On Sun, Jan 4, 2009 at 12:15 PM, Jochen Topf <jochen at remote.org> wrote:
>>> Somebody just asked on the German mailing list about Google not finding
>>> pages from our wiki any more. I just checked this and it does find some,
>>> but they are all still ../index.php/.. URLs. Looking at the robots.txt and
>>> the Sitemap, it should find the new ../wiki/.. URLs, but maybe something
>>> is wrong somewhere.
>>>
>>
>>
>> +1  It's impossible to find stuff on the wiki with google
>>
>> http://www.google.se/search?&q=site%3Awiki.openstreetmap.org+-inurl%3Aindex+-inurl%3Aimages
>>
>> http://trac.openstreetmap.org/ticket/1496
>
> The googlebot is probably blocked as bots tend to kill the wiki due to
> the extreme crapness of mediawiki.

Bots happily hit Wikipedia all day without killing it, is the OSM wiki
set up equivalently? I.e. with a cache in front of it, memcache to
cache various things within MW etc?