Brett<br>No problem, I'll fix up my end to handle gz for the moment. Maybe we can standardise one one or the other format when you get back.<br><br>80n<br><br><div class="gmail_quote">On Nov 30, 2007 1:05 AM, Brett Henderson <
<a href="mailto:brett@bretth.com">brett@bretth.com</a>> wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">Sorry, I think I've run out of time, I'm hoping to get out of here in a
<br>few hours and I still have a fair bit to get done. I can fix it up when<br>I get back in two weeks although that is probably too late.<br><br>The reason I'm using gz is because I'm streaming the data direct from db
<br>to file and the java bz2 implementation I'm using isn't very fast. The<br>daily scripts are using the command line bzip2 running at nice 10 after<br>the database read has completed. I suspect the java gz implementation
<br>uses native code, it's very fast (hourly extract takes approx 30 seconds<br>clock time). I was trying to avoid holding locks on the main db for too<br>long.<br><br>I was going to disable it while I was away but it seems to be running
<br>okay and is very quick (minimal extra load on dev) so I'll leave it running.<br><div class="Ih2E3d"><br>80n wrote:<br>> Brett<br>> Yes, I can definitely use these hourly diffs.<br>><br>> Could you make them .bz2's rather than .gz's please? Otherwise I have
<br>> to change my scripts.<br>><br>> 80n<br>><br>> On Nov 29, 2007 12:09 PM, Brett Henderson < <a href="mailto:brett@bretth.com">brett@bretth.com</a><br></div><div class="Ih2E3d">> <mailto:<a href="mailto:brett@bretth.com">
brett@bretth.com</a>>> wrote:<br>><br>> Hi All,<br>><br>> If you check out <a href="http://planet.openstreetmap.org/daily/hourly" target="_blank">http://planet.openstreetmap.org/daily/hourly</a><br>
> you'll see<br>> hourly changesets appearing. This is just an experiment for now<br>> and I'm<br>> planning to disable them while I'm away.<br>><br>> Would anybody be able to make use of them? Any process that
<br>> creates new<br>> planet files is probably best served by the existing daily changesets.<br>> But if an application can use changesets directly (eg. to keep a<br>> database up to date) they may be
useful.ley<br>><br>> Any thoughts appreciated.<br>><br>> Cheers,<br>> Brett<br>><br>><br>> _______________________________________________<br>> dev mailing list<br></div>>
<a href="mailto:dev@openstreetmap.org">dev@openstreetmap.org</a> <mailto:<a href="mailto:dev@openstreetmap.org">dev@openstreetmap.org</a>><br><div><div></div><div class="Wj3C7c">> <a href="http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev" target="_blank">
http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev</a><br>><br>><br><br><br>_______________________________________________<br>dev mailing list<br><a href="mailto:dev@openstreetmap.org">dev@openstreetmap.org
</a><br><a href="http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev" target="_blank">http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev</a><br></div></div></blockquote></div><br>