<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 12 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.hoenzb
{mso-style-name:hoenzb;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Thanks very much for looking into this Toby. I’ve been attempting to run a trace from my company’s server to planet.osm.org using tracepath and traceroute, but I’m getting
“no reply” or similar at every hop. I’m thinking this may have to do with our network settings as I’m getting the same results with any address that I try, so I’ve inquired about this and will post the trace path if I’m able to get addresses for the hops.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Beyond that do you (or others) have recommendations for next steps? Should I look to determine which hop is slowing things down and attempt to contact them?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Toby Murray [mailto:toby.murray@gmail.com]
<br>
<b>Sent:</b> Thursday, November 13, 2014 8:10 AM<br>
<b>Cc:</b> dev@openstreetmap.org<br>
<b>Subject:</b> Re: [OSM-dev] Changefile Downloads Stalling<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">I was one of the people on IRC yesterday and can confirm that I am seeing similar problems when downloading files from
<a href="http://planet.osm.org">planet.osm.org</a> while at work (university campus) however when downloading to a VM I have with cloudatcost (I think they are in Canada), I am not having any problems.<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I just tried to download the latest note dump file. The first time it stalled out at 2.6 MB. A second attempt stalled at 1.something then picked back up to 3 MB. Now it is trickling in at less than 70 KB/sec.<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Since this looks like something happening along the way and not at either end, here is a trace from me to
<a href="http://planet.osm.org">planet.osm.org</a>:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"> 1?: [LOCALHOST] pmtu 1500<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> 1: no reply<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> 2: no reply<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> 3: <a href="http://kanren-ksu-pplant-border.peer.net.kanren.net">kanren-ksu-pplant-border.peer.net.kanren.net</a> 2.479ms <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> 4: <a href="http://bb-ksu-hale-e2-1.bb.net.kanren.net">bb-ksu-hale-e2-1.bb.net.kanren.net</a> 3.196ms <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> 5: <a href="http://bb-kc-walnut-e2-4.bb.net.kanren.net">bb-kc-walnut-e2-4.bb.net.kanren.net</a> 6.768ms <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> 6: <a href="http://et-10-0-0.1050.rtr.kans.net.internet2.edu">et-10-0-0.1050.rtr.kans.net.internet2.edu</a> 5.911ms <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> 7: <a href="http://et-9-0-0.106.rtr.chic.net.internet2.edu">et-9-0-0.106.rtr.chic.net.internet2.edu</a> 17.584ms <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> 8: <a href="http://et-9-0-0.115.rtr.wash.net.internet2.edu">et-9-0-0.115.rtr.wash.net.internet2.edu</a> 35.037ms <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> 9: <a href="http://abilene-wash.mx1.fra.de.geant.net">abilene-wash.mx1.fra.de.geant.net</a> 127.550ms <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">10: <a href="http://ae1.mx1.ams.nl.geant.net">ae1.mx1.ams.nl.geant.net</a> 133.560ms <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">11: <a href="http://ae2.mx1.lon.uk.geant.net">ae2.mx1.lon.uk.geant.net</a> 155.513ms <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">12: <a href="http://janet-gw.mx1.lon.uk.geant.net">janet-gw.mx1.lon.uk.geant.net</a> 158.483ms <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">13: <a href="http://ae29.londpg-sbr1.ja.net">ae29.londpg-sbr1.ja.net</a> 169.894ms <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">14: <a href="http://be24.londic-rbr1.ja.net">be24.londic-rbr1.ja.net</a> 157.260ms <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">15: <a href="http://imperial-college.ja.net">imperial-college.ja.net</a> 158.031ms <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">16: <a href="http://me-rach.net.ic.ac.uk">me-rach.net.ic.ac.uk</a> 142.874ms <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">17: no reply<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">18: no reply<o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Toby<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Tue, Nov 11, 2014 at 7:31 PM, Humphries, Grant <<a href="mailto:HumphriG@trimet.org" target="_blank">HumphriG@trimet.org</a>> wrote:<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Hi All,
<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I have been trying intermittently for a few weeks now to use osmupdate to refresh a local OSM extract. The problem that I am having relates to the download of changefiles from
<a href="http://planet.openstreetmap.org" target="_blank">planet.openstreetmap.org</a>. Ultimately I want to update my extract once per day, so most of the changefiles that need to be downloaded and applied are of the hourly variety, such as this one:
<a href="http://planet.openstreetmap.org/replication/hour/000/018/973.osc.gz" target="_blank">
http://planet.openstreetmap.org/replication/hour/000/018/973.osc.gz</a> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">These files are generally 2 to 5 MB in size and the problem that I’m having is that my download will stall, sometimes for 20 to 30 minutes, sometimes up to a couple of hours, on
one or more of these small changefiles virtually every time I attempt to use osmupdate. The odd thing is that changefiles that are downloaded back-to-back, and that are roughly the same size can take vastly different amounts of time to complete. For instance
today osmupdate started with changefile 18975 and 18974 which took seconds, but then 18973 took around 20+ minutes. I’m running this tool on a linux cent os server, and osmupdate uses wget to download the files. I’ve tried using wget and curl on the same
files outside of osmupdate and the problem persists. I’ve also tried downloading the files through Firefox on a windows PC and had similar problems. I’ve asked others on IRC to attempt the same downloads with varying results, some experience a similar lag,
and some are able to download the same files I’m having trouble with in seconds.
<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I was just going to say that this file in particular has given me trouble
<span style="color:#1F497D"><a href="https://planet.openstreetmap.org/replication/hour/000/018/823.osc.gz" target="_blank">https://planet.openstreetmap.org/replication/hour/000/018/823.osc.gz</a>
</span>as I have tried to download it many times and it has always stalled and taken an extremely long time to complete, but I just tried it one more time and it took 8.8 seconds. So is this kind of variance to be expected?
<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Thanks in advance for any help<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Best,
<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#888888"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#888888">-Grant<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:#888888"> <o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
_______________________________________________<br>
dev mailing list<br>
<a href="mailto:dev@openstreetmap.org">dev@openstreetmap.org</a><br>
<a href="https://lists.openstreetmap.org/listinfo/dev" target="_blank">https://lists.openstreetmap.org/listinfo/dev</a><o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</body>
</html>