[Geocoding] Local Mirror of OSM Data...

[Peter Childs]

2009/10/23 Emilie Laffray <emilie.laffray at gmail.com>

>
>
> 2009/10/23 Frederik Ramm <frederik at remote.org>
>
> Hi,
>>
>> Peter Childs wrote:
>> > Currently I'm importing planet.osm into a postgres database using
>> > osmosis so see how big it is, But its been going all night, and looks
>> > like its only done about 5% where as decompressing the planet takes
>> > about 2 hours, so I was expecting it done in kind of say 6?
>>
>> You aren't using
>>
>> osmosis --wx planet.osm.bz2
>>
>> by any chance? It is a known fact that the Java .bz2 implementation is
>> crap. You need to do
>>
>> bzcat planet.osm.bz2 | osmosis --wx -
>>
>> which will probably triple (treble?) performance.
>>
>
> Don't you mean --rx? :)
>
>
No I'm using...

bzcat planet-latest.osm.bz2 | osmosis-0.31/bin/osmosis --read-xml
file=/dev/stdin --write-pgsql database=map

and apparently CPU usage, (according to TOP, (Give or take))

osmosis 55%, postgres 15%, bzcat 12%

Can't believe it takes 4 times the resources to convert XML that it takes to
decompress a file.....

Peter
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/geocoding/attachments/20091023/5e0991b0/attachment.html>