[OSM-dev] Osmosis Failing to Read Particular Replicate Files

[Brett Henderson]

On Fri, Apr 9, 2010 at 5:40 AM, Aaron Schaefer <aaron at elasticdog.com> wrote:

> The file does download just fine using wget/curl, and I always thought
> it was odd that it was failing on the same file even on different
> mirrors. I had assumed that due to the sequence number that this was
> not the first file it had tried to download, but that might not be the
> case. Because you mentioned it looked like a network issue, I ran
> things verbosely and then tried adding the trailing slash to the
> baseURL...that fixed it!
>

It's great it's working, although I've never added the trailing slash.  I'm
not sure what's going on there ...

You're right in saying that the sequence number didn't look like the first
one.  However I suspect the state file you downloaded wasn't used somehow
because it sounds like it started processing from a much later time than you
said you used.  I'm not too sure what happened there.

You really need to look at the contents of the state file to be sure, not
the creation timestamp of the file itself because they're not necessarily
related.


>
> When you initialize the working directory, the example
> configuration.txt file lists
> 'baseUrl=http://planet.openstreetmap.org/minute-replicate' (note
> there's no trailing slash), so I had just switched /minute/hour/ and
> thought it would be fine. So, dumb mistake, but it works fine now.
>
> Per your advice, I did switch maxInterval as well, but had another
> question. Daily diffs would be great, but from my understanding after
> talking with people on IRC, was that there wasn't an easy way to
> download and import daily diffs using osmosis because there are no
> managed state.txt files like there are with the minute/hour replicate
> diffs. So, the conclusion I came to was to just run a daily cron job
> that would grab a days worth of hourly diffs and apply those. Is there
> a better way? Thanks again for your help...I really appreciate it.
>

Have you checked out the Osmosis detailed usage page?  There are several
replication tasks there:
http://wiki.openstreetmap.org/wiki/Osmosis/DetailedUsage#Replication_Tasks

The one you need for daily diffs is the --rci task instead of the --rri
task.  The --rci is an older style of replication which is based on
filenames using timestamps.  It works okay for daily diffs, but isn't
suitable for minute or hourly diffs.

If you have the hourly diffs working I'd stick with them.

Brett
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20100409/2e35a2c2/attachment.html>