<div dir="ltr">I was one of the people on IRC yesterday and can confirm that I am seeing similar problems when downloading files from <a href="http://planet.osm.org">planet.osm.org</a> while at work (university campus) however when downloading to a VM I have with cloudatcost (I think they are in Canada), I am not having any problems.<div><br></div><div>I just tried to download the latest note dump file. The first time it stalled out at 2.6 MB. A second attempt stalled at 1.something then picked back up to 3 MB. Now it is trickling in at less than 70 KB/sec.<br><div><br></div><div>Since this looks like something happening along the way and not at either end, here is a trace from me to <a href="http://planet.osm.org">planet.osm.org</a>:</div><div><br></div><div><div> 1?: [LOCALHOST] pmtu 1500</div><div> 1: no reply</div><div> 2: no reply</div><div> 3: <a href="http://kanren-ksu-pplant-border.peer.net.kanren.net">kanren-ksu-pplant-border.peer.net.kanren.net</a> 2.479ms </div><div> 4: <a href="http://bb-ksu-hale-e2-1.bb.net.kanren.net">bb-ksu-hale-e2-1.bb.net.kanren.net</a> 3.196ms </div><div> 5: <a href="http://bb-kc-walnut-e2-4.bb.net.kanren.net">bb-kc-walnut-e2-4.bb.net.kanren.net</a> 6.768ms </div><div> 6: <a href="http://et-10-0-0.1050.rtr.kans.net.internet2.edu">et-10-0-0.1050.rtr.kans.net.internet2.edu</a> 5.911ms </div><div> 7: <a href="http://et-9-0-0.106.rtr.chic.net.internet2.edu">et-9-0-0.106.rtr.chic.net.internet2.edu</a> 17.584ms </div><div> 8: <a href="http://et-9-0-0.115.rtr.wash.net.internet2.edu">et-9-0-0.115.rtr.wash.net.internet2.edu</a> 35.037ms </div><div> 9: <a href="http://abilene-wash.mx1.fra.de.geant.net">abilene-wash.mx1.fra.de.geant.net</a> 127.550ms </div><div>10: <a href="http://ae1.mx1.ams.nl.geant.net">ae1.mx1.ams.nl.geant.net</a> 133.560ms </div><div>11: <a href="http://ae2.mx1.lon.uk.geant.net">ae2.mx1.lon.uk.geant.net</a> 155.513ms </div><div>12: <a href="http://janet-gw.mx1.lon.uk.geant.net">janet-gw.mx1.lon.uk.geant.net</a> 158.483ms </div><div>13: <a href="http://ae29.londpg-sbr1.ja.net">ae29.londpg-sbr1.ja.net</a> 169.894ms </div><div>14: <a href="http://be24.londic-rbr1.ja.net">be24.londic-rbr1.ja.net</a> 157.260ms </div><div>15: <a href="http://imperial-college.ja.net">imperial-college.ja.net</a> 158.031ms </div><div>16: <a href="http://me-rach.net.ic.ac.uk">me-rach.net.ic.ac.uk</a> 142.874ms </div><div>17: no reply</div><div>18: no reply</div></div><div><br></div><div><br></div><div>Toby</div><div><br></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Nov 11, 2014 at 7:31 PM, Humphries, Grant <span dir="ltr"><<a href="mailto:HumphriG@trimet.org" target="_blank">HumphriG@trimet.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="blue" vlink="purple">
<div>
<p class="MsoNormal">Hi All, <u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">I have been trying intermittently for a few weeks now to use osmupdate to refresh a local OSM extract. The problem that I am having relates to the download of changefiles from <a href="http://planet.openstreetmap.org" target="_blank">planet.openstreetmap.org</a>. Ultimately I want to update my extract
once per day, so most of the changefiles that need to be downloaded and applied are of the hourly variety, such as this one:
<a href="http://planet.openstreetmap.org/replication/hour/000/018/973.osc.gz" target="_blank">http://planet.openstreetmap.org/replication/hour/000/018/973.osc.gz</a>
<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">These files are generally 2 to 5 MB in size and the problem that I’m having is that my download will stall, sometimes for 20 to 30 minutes, sometimes up to a couple of hours, on one or more of these small changefiles virtually every time
I attempt to use osmupdate. The odd thing is that changefiles that are downloaded back-to-back, and that are roughly the same size can take vastly different amounts of time to complete. For instance today osmupdate started with changefile 18975 and 18974
which took seconds, but then 18973 took around 20+ minutes. I’m running this tool on a linux cent os server, and osmupdate uses wget to download the files. I’ve tried using wget and curl on the same files outside of osmupdate and the problem persists. I’ve
also tried downloading the files through Firefox on a windows PC and had similar problems. I’ve asked others on IRC to attempt the same downloads with varying results, some experience a similar lag, and some are able to download the same files I’m having
trouble with in seconds. <u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">I was just going to say that this file in particular has given me trouble
<span style="color:#1f497d"><a href="https://planet.openstreetmap.org/replication/hour/000/018/823.osc.gz" target="_blank">https://planet.openstreetmap.org/replication/hour/000/018/823.osc.gz</a>
</span>as I have tried to download it many times and it has always stalled and taken an extremely long time to complete, but I just tried it one more time and it took 8.8 seconds. So is this kind of variance to be expected?
<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Thanks in advance for any help<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Best, <span class="HOEnZb"><font color="#888888"><u></u><u></u></font></span></p><span class="HOEnZb"><font color="#888888">
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">-Grant<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
</font></span></div>
</div>
<br>_______________________________________________<br>
dev mailing list<br>
<a href="mailto:dev@openstreetmap.org">dev@openstreetmap.org</a><br>
<a href="https://lists.openstreetmap.org/listinfo/dev" target="_blank">https://lists.openstreetmap.org/listinfo/dev</a><br>
<br></blockquote></div><br></div>