[openstreetmap-website] Update robots.txt (#565)

[Paul Norman]

With the redesign, some URLs have changed.

robots.txt should reference these URLs. Additionally, nodes/ways/relations are allowed in robots.txt, but not notes.

---
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/openstreetmap-website/issues/565
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/rails-dev/attachments/20131130/9a29bea8/attachment.html>