<div dir="ltr"><div>Hi Jochen,</div><div><br></div><div>applying the 2 minutely files to the PBF worked nicely and passed osmium check-refs. Seems that is the only cause.<br></div><div><br></div><div>Thanks for looking into it and sharing the minutely files.<font color="#888888"><br></font></div><font color="#888888"><div>Manohar</div></font></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Dec 2, 2020 at 5:41 AM Jochen Topf <<a href="mailto:jochen@remote.org">jochen@remote.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi!<br>
<br>
There is a problem with the hourly diffs. From my analysis it looks like<br>
minutely diff 4304922 is in hourly diff 72012 and minutely diff 430925<br>
is in hourly 72013, but the two minutely diffs in between (4304923 and<br>
4304924) are in neither. So you are definitely missing some data and<br>
osmium check-refs found part of that.<br>
<br>
Sysadmins are aware of the problem and maybe we going to get a fixed<br>
hourly file. If not you should be able to fix this by applying those two<br>
minutely diffs and then re-applying all the hourly diffs from that<br>
point.<br>
<br>
Jochen<br>
<br>
On Tue, Dec 01, 2020 at 11:53:49AM -0500, Manohar Erikipati via dev wrote:<br>
> Date: Tue, 1 Dec 2020 11:53:49 -0500<br>
> From: Manohar Erikipati via dev <<a href="mailto:dev@openstreetmap.org" target="_blank">dev@openstreetmap.org</a>><br>
> To: <a href="mailto:dev@openstreetmap.org" target="_blank">dev@openstreetmap.org</a><br>
> Subject: [OSM-dev] osmium check-refs failing on latest assembled PBF with<br>
> hourly changes<br>
> <br>
> Hi, we have been applying new hourly changesets to create a daily PBF. This<br>
> works very well and it is continuously stable. Recently, when the hourly<br>
> changes were applied, I noticed a failure in osmium check-refs.<br>
> <br>
> Hourly file changes applied are from these files<br>
> <br>
> from hour/000/071/849.osc.gz to hour/000/072/051.osc.gz<br>
> <br>
> Updating sequence number from 71849 to 72051<br>
> <br>
> Running a osmium check-refs * on the updated PBF results in several<br>
> referential check failures for nodes. Nodes that belong to below OSM ways.<br>
> When I looked into these OSM ways through JOSM, I could not spot any<br>
> problems.<br>
> <br>
> Ways<br>
> <br>
> <a href="https://www.openstreetmap.org/way/185306812" rel="noreferrer" target="_blank">https://www.openstreetmap.org/way/185306812</a><br>
> <br>
> <a href="https://www.openstreetmap.org/way/36960460" rel="noreferrer" target="_blank">https://www.openstreetmap.org/way/36960460</a><br>
> <br>
> <a href="https://www.openstreetmap.org/way/326450137" rel="noreferrer" target="_blank">https://www.openstreetmap.org/way/326450137</a><br>
> <br>
> <a href="https://www.openstreetmap.org/way/872325295" rel="noreferrer" target="_blank">https://www.openstreetmap.org/way/872325295</a><br>
> <br>
> <a href="https://www.openstreetmap.org/way/878901824" rel="noreferrer" target="_blank">https://www.openstreetmap.org/way/878901824</a><br>
> <br>
> <a href="https://www.openstreetmap.org/way/878968187" rel="noreferrer" target="_blank">https://www.openstreetmap.org/way/878968187</a><br>
> <br>
> <a href="https://www.openstreetmap.org/way/878968195" rel="noreferrer" target="_blank">https://www.openstreetmap.org/way/878968195</a><br>
> <br>
> Example nodes<br>
> <br>
> <a href="https://www.openstreetmap.org/node/8176907685" rel="noreferrer" target="_blank">https://www.openstreetmap.org/node/8176907685</a><br>
> <br>
> <a href="https://www.openstreetmap.org/node/8176907689" rel="noreferrer" target="_blank">https://www.openstreetmap.org/node/8176907689</a><br>
> <br>
> <a href="https://www.openstreetmap.org/node/8176907690" rel="noreferrer" target="_blank">https://www.openstreetmap.org/node/8176907690</a><br>
> <br>
> <a href="https://www.openstreetmap.org/node/8176907686" rel="noreferrer" target="_blank">https://www.openstreetmap.org/node/8176907686</a><br>
> <br>
> <a href="https://www.openstreetmap.org/node/8176968661" rel="noreferrer" target="_blank">https://www.openstreetmap.org/node/8176968661</a><br>
> <br>
> <a href="https://www.openstreetmap.org/node/8176907653" rel="noreferrer" target="_blank">https://www.openstreetmap.org/node/8176907653</a><br>
> <br>
> Could someone help if they have observed any missing data in the hourly<br>
> files or if osmium check-refs itself is not highlighting any problematic<br>
> relation.<br>
> <br>
> Any help is appreciated, thanks.<br>
> <br>
> Manohar<br>
> <br>
> <a href="https://www.openstreetmap.org/user/manoharuss" rel="noreferrer" target="_blank">https://www.openstreetmap.org/user/manoharuss</a><br>
<br>
> _______________________________________________<br>
> dev mailing list<br>
> <a href="mailto:dev@openstreetmap.org" target="_blank">dev@openstreetmap.org</a><br>
> <a href="https://lists.openstreetmap.org/listinfo/dev" rel="noreferrer" target="_blank">https://lists.openstreetmap.org/listinfo/dev</a><br>
<br>
<br>
-- <br>
Jochen Topf <a href="mailto:jochen@remote.org" target="_blank">jochen@remote.org</a> <a href="https://www.jochentopf.com/" rel="noreferrer" target="_blank">https://www.jochentopf.com/</a> +49-351-31778688<br>
<br>
_______________________________________________<br>
dev mailing list<br>
<a href="mailto:dev@openstreetmap.org" target="_blank">dev@openstreetmap.org</a><br>
<a href="https://lists.openstreetmap.org/listinfo/dev" rel="noreferrer" target="_blank">https://lists.openstreetmap.org/listinfo/dev</a><br>
</blockquote></div>