[Osmf-talk] February OSMF Board Meeting

[Gervase Markham]

On 26/02/10 10:37, Tom Hughes wrote:
> Probably, if you can tell me how. Unfortunately the robots.txt standard
> is so completely shit that in the end I gave up trying to block the
> things that were causing problems and just blocked everything in favour
> of using a sitemap instead.
> 
> If you can give me robots.txt speak that allows the home page and blocks
> everything else then we could probably use that.

I'm sorry you had to deal with robots.txt :-| I also don't know the
syntax; I assumed (wrongly, it seems) that this would be an easy change.

Gerv