[OSM-dev] Broken Daily Replication Diffs

Stéphane Henriod s at henriod.info
Tue Sep 4 06:48:31 BST 2012


Hi Brett

Is this problem only for the daily diffs, or also for the minutes and
hours? I am trying to get the minutely diffs working and get some strange
error messages "*Unable to read the changeset file on the server*"

Actually, I can't even make a wget on the files in the minute-replicate:

wget
> http://planet.openstreetmap.org/redaction-period/minute-replicate/state.txt
>

very often (but not always) returns

--2012-09-04 07:46:21--
> http://planet.openstreetmap.org/redaction-period/minute
> -replicate/state.txt
> Resolving planet.openstreetmap.org... 193.63.75.101
> Connecting to planet.openstreetmap.org|193.63.75.101|:80... failed:
> Connection r
> efused.
>

whereas

wget
> http://planet.openstreetmap.org/redaction-period/hour-replicate/state.txt
>

systematically downloads the file properly.

Am I doing something wrong or is there a problem with the state files for
the minute diffs?

Thanks!

Stéphane

--
"Le mot progrès n'aura aucun sens tant qu'il y aura des enfants malheureux"
-- Albert Einstein

"A journey does not need reasons. Before long, it proves to be reason
enough in itself. One thinks that one is going to make a journey, yet soon
it is the journey that makes or unmakes you." -- Nicolas Bouvier

Photos de voyages, photos de montagne: http://www.henriod.info



On Sat, Sep 1, 2012 at 5:14 PM, Brett Henderson <brett at bretth.com> wrote:

> Hi All,
>
> Please note that there have been some problems with the daily replication
> diffs in the last couple of days.
> http://planet.openstreetmap.org/redaction-period/day-replicate/
>
> BACKGROUND
> All files after 148 were incorrectly created.  The data in them was more
> or less valid data, but they were being generated hourly and with incorrect
> timestamps in the state files.  Each file claimed to contain an entire day
> of data, but in reality it only contained a single hour of data.  In
> addition, the state files were claiming to contain data from days into the
> future.  This was all due to a bug in the 0.41 version of Osmosis in its
> dealing with replication file time boundaries.  It has been fixed in the
> latest development codebase and activated on the planet server.  This bug
> only affects server-side replication from the apidb database, and has no
> impact on client-side consumption of the data.  It is safe to use 0.41 on
> the client side.
>
> MANUAL FIXUP STEPS REQUIRED
> If you are using consuming the day-replicate files with Osmosis, you will
> need to reset your replication state back to sequence number 148 and begin
> processing from that point again.
>
> To do this, download the following file and overwrite the "state.txt" in
> your local working directory.
>
> http://planet.openstreetmap.org/redaction-period/day-replicate/000/000/148.state.txt
>
> Performing the above step will cause Osmosis to begin process from 149
> onwards again.
>
> Apologies for the inconvenience,
> Brett
>
>
> _______________________________________________
> dev mailing list
> dev at openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20120904/c033d6db/attachment.html>


More information about the dev mailing list