<p>Ah, there's an issue with the robots.txt change: you need to remove the trailing slash in</p>
<pre><code>Disallow: /user/*/diary/
</code></pre>
<p>and replace it by</p>
<pre><code>Disallow: /user/*/diary
</code></pre>
<p>Otherwise, the user's blog list (e.g. <a href="https://www.openstreetmap.org/user/TomH/diary" rel="nofollow">https://www.openstreetmap.org/user/TomH/diary</a> ) still gets indexed.</p>
<p>Test tool I used: <a href="https://webmaster.yandex.com/tools/robotstxt/?hostName=https%3A%2F%2Fwww.openstreetmap.org%2Frobots.txt" rel="nofollow">https://webmaster.yandex.com/tools/robotstxt/?hostName=https%3A%2F%2Fwww.openstreetmap.org%2Frobots.txt</a></p>
<p style="font-size:small;-webkit-text-size-adjust:none;color:#666;">—<br />You are receiving this because you are subscribed to this thread.<br />Reply to this email directly, <a href="https://github.com/openstreetmap/openstreetmap-website/issues/2218?email_source=notifications&email_token=AAK2OLOWLRNLNNOLHPGF7D3PWBILZA5CNFSM4HI6FEDKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODVWUJ7Y#issuecomment-493700351">view it on GitHub</a>, or <a href="https://github.com/notifications/unsubscribe-auth/AAK2OLPJWGEMDCZ2CKWDGOTPWBILZANCNFSM4HI6FEDA">mute the thread</a>.<img src="https://github.com/notifications/beacon/AAK2OLI3JXJIB4MZ3ORGQT3PWBILZA5CNFSM4HI6FEDKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODVWUJ7Y.gif" height="1" width="1" alt="" /></p>
<script type="application/ld+json">[
{
"@context": "http://schema.org",
"@type": "EmailMessage",
"potentialAction": {
"@type": "ViewAction",
"target": "https://github.com/openstreetmap/openstreetmap-website/issues/2218?email_source=notifications\u0026email_token=AAK2OLOWLRNLNNOLHPGF7D3PWBILZA5CNFSM4HI6FEDKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODVWUJ7Y#issuecomment-493700351",
"url": "https://github.com/openstreetmap/openstreetmap-website/issues/2218?email_source=notifications\u0026email_token=AAK2OLOWLRNLNNOLHPGF7D3PWBILZA5CNFSM4HI6FEDKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODVWUJ7Y#issuecomment-493700351",
"name": "View Issue"
},
"description": "View this Issue on GitHub",
"publisher": {
"@type": "Organization",
"name": "GitHub",
"url": "https://github.com"
}
}
]</script>