[openstreetmap/openstreetmap-website] Add noindex meta tag to diary index pages (#3029)

[Tom Hughes]

I'm not sure I have a view - it's not something I know anything about.

Is it even possible to do this via `robots.txt` though? Won't that block crawling altogether?

I'm not sure what any of this has to do with canonical URLs though?

Frankly I had to check to make sure we didn't have the diary indexes blocked already as I think we did at one point because the pagination makes crawling them insanely expensive... They don't seem to be blocked at the moment though.

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/openstreetmap-website/pull/3029#issuecomment-755525214
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/rails-dev/attachments/20210106/560500ad/attachment.htm>