[openstreetmap/openstreetmap-website] Expand robots.txt to stop pages robots are getting stuck in (PR #6875)

[Tom Hughes]

Merged #6875 into master.

-- 
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/openstreetmap-website/pull/6875#event-23464464722
You are receiving this because you are subscribed to this thread.

Message ID: <openstreetmap/openstreetmap-website/pull/6875/issue_event/23464464722 at github.com>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/rails-dev/attachments/20260311/5f48ede7/attachment.htm>