[OSM-dev] Hourly Diffs

[80n]

Brett
No problem, I'll fix up my end to handle gz for the moment.  Maybe we can
standardise one one or the other format when you get back.

80n

On Nov 30, 2007 1:05 AM, Brett Henderson <brett at bretth.com> wrote:

> Sorry, I think I've run out of time, I'm hoping to get out of here in a
> few hours and I still have a fair bit to get done.  I can fix it up when
> I get back in two weeks although that is probably too late.
>
> The reason I'm using gz is because I'm streaming the data direct from db
> to file and the java bz2 implementation I'm using isn't very fast.  The
> daily scripts are using the command line bzip2 running at nice 10 after
> the database read has completed.  I suspect the java gz implementation
> uses native code, it's very fast (hourly extract takes approx 30 seconds
> clock time).  I was trying to avoid holding locks on the main db for too
> long.
>
> I was going to disable it while I was away but it seems to be running
> okay and is very quick (minimal extra load on dev) so I'll leave it
> running.
>
> 80n wrote:
> > Brett
> > Yes, I can definitely use these hourly diffs.
> >
> > Could you make them .bz2's rather than .gz's please? Otherwise I have
> > to change my scripts.
> >
> > 80n
> >
> > On Nov 29, 2007 12:09 PM, Brett Henderson < brett at bretth.com
> > <mailto:brett at bretth.com>> wrote:
> >
> >     Hi All,
> >
> >     If you check out http://planet.openstreetmap.org/daily/hourly
> >     you'll see
> >     hourly changesets appearing.  This is just an experiment for now
> >     and I'm
> >     planning to disable them while I'm away.
> >
> >     Would anybody be able to make use of them?  Any process that
> >     creates new
> >     planet files is probably best served by the existing daily
> changesets.
> >     But if an application can use changesets directly (eg. to keep a
> >     database up to date) they may be useful.ley
> >
> >     Any thoughts appreciated.
> >
> >     Cheers,
> >     Brett
> >
> >
> >     _______________________________________________
> >     dev mailing list
> >     dev at openstreetmap.org <mailto:dev at openstreetmap.org>
> >     http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
> >
> >
>
>
> _______________________________________________
> dev mailing list
> dev at openstreetmap.org
> http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20071130/fec04446/attachment.html>