[openstreetmap/openstreetmap-website] Omit diaries containing Chinese characters from RSS feed (#2218)

[mmd]

Ah, there's an issue with the robots.txt change: you need to remove the trailing slash in

```
Disallow: /user/*/diary/
```

and replace it by

```
Disallow: /user/*/diary
```

Otherwise, the user's blog list (e.g. https://www.openstreetmap.org/user/TomH/diary ) still gets indexed.

Test tool I used: https://webmaster.yandex.com/tools/robotstxt/?hostName=https%3A%2F%2Fwww.openstreetmap.org%2Frobots.txt

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/openstreetmap-website/issues/2218#issuecomment-493700351
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/rails-dev/attachments/20190518/65235fa7/attachment.html>