[OSM-dev] Hourly Diffs

[Brett Henderson]

Sorry, I think I've run out of time, I'm hoping to get out of here in a 
few hours and I still have a fair bit to get done.  I can fix it up when 
I get back in two weeks although that is probably too late.

The reason I'm using gz is because I'm streaming the data direct from db 
to file and the java bz2 implementation I'm using isn't very fast.  The 
daily scripts are using the command line bzip2 running at nice 10 after 
the database read has completed.  I suspect the java gz implementation 
uses native code, it's very fast (hourly extract takes approx 30 seconds 
clock time).  I was trying to avoid holding locks on the main db for too 
long.

I was going to disable it while I was away but it seems to be running 
okay and is very quick (minimal extra load on dev) so I'll leave it running.

80n wrote:
> Brett
> Yes, I can definitely use these hourly diffs.
>
> Could you make them .bz2's rather than .gz's please? Otherwise I have 
> to change my scripts.
>
> 80n
>
> On Nov 29, 2007 12:09 PM, Brett Henderson < brett at bretth.com 
> <mailto:brett at bretth.com>> wrote:
>
>     Hi All,
>
>     If you check out http://planet.openstreetmap.org/daily/hourly
>     you'll see
>     hourly changesets appearing.  This is just an experiment for now
>     and I'm
>     planning to disable them while I'm away.
>
>     Would anybody be able to make use of them?  Any process that
>     creates new
>     planet files is probably best served by the existing daily changesets.
>     But if an application can use changesets directly (eg. to keep a
>     database up to date) they may be useful.ley
>
>     Any thoughts appreciated.
>
>     Cheers,
>     Brett
>
>
>     _______________________________________________
>     dev mailing list
>     dev at openstreetmap.org <mailto:dev at openstreetmap.org>
>     http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
>
>