[openstreetmap/openstreetmap-website] Add planet link and explanation to robots.txt (PR #5034)

[Guillaume Rischard]

Recent scraping incidents have made think that a friendly pointer to planet.osm.org probably wouldn't hurt.
You can view, comment on, or merge this pull request online at:

  https://github.com/openstreetmap/openstreetmap-website/pull/5034

-- Commit Summary --

  * Add planet link and explanation to robots.txt

-- File Changes --

    M public/robots.txt (5)

-- Patch Links --

https://github.com/openstreetmap/openstreetmap-website/pull/5034.patch
https://github.com/openstreetmap/openstreetmap-website/pull/5034.diff

-- 
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/openstreetmap-website/pull/5034
You are receiving this because you are subscribed to this thread.

Message ID: <openstreetmap/openstreetmap-website/pull/5034 at github.com>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/rails-dev/attachments/20240730/811261a5/attachment-0001.htm>