[openstreetmap-website] Updated robots.txt for new routes (no more /browse) (#761)

Tom Hughes notifications at github.com
Tue Jun 17 20:40:19 UTC 2014


I believe they were blocked to try and stop robots killing the site, but given that the rules have been broken for six months now without seemingly causing problems may be don't need to them anymore?

What do you think @Firefishy?

---
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/openstreetmap-website/pull/761#issuecomment-46362103
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/rails-dev/attachments/20140617/3688fc50/attachment.html>


More information about the rails-dev mailing list