[OSM-dev] Slow osmosis import
merspieler
merspieler at airmail.cc
Fri Oct 4 11:06:46 UTC 2019
I'm currently trying to import the planet.osm.pbf file with osmosis.
While it's quite fast with nodes (took about 7h) it massively lows down
when it comes to the ways.
INFO: Processing Node 6814667967, 307145.5708858228 objects/second.
Oct 04, 2019 9:13:37 AM
org.openstreetmap.osmosis.core.progress.v0_6.EntityProgressLogger process
INFO: Processing Node 6816253174, 296264.7470505899 objects/second.
Oct 04, 2019 9:13:43 AM
org.openstreetmap.osmosis.core.progress.v0_6.EntityProgressLogger process
INFO: Processing Way 92, 5606.095551894564 objects/second.
Oct 04, 2019 9:13:48 AM
org.openstreetmap.osmosis.core.progress.v0_6.EntityProgressLogger process
INFO: Processing Way 111, 2.3990403838464616 objects/second.
Oct 04, 2019 9:13:54 AM
org.openstreetmap.osmosis.core.progress.v0_6.EntityProgressLogger process
INFO: Processing Way 135, 2.727272727272727 objects/second.
It would take years to import it at this speed.
I run it like this:
osmosis --read-pbf file=path/to/planet.osm.pbf --log-progress
--write-pgsql database=osm_world password="not your business"
$JAVACMD_OPTIONS -Djava.io.tmpdir is set to use the same RAID as the
.pbf file and database. I've added as well -Xmx40G to see if it has
something to do with the ram but that didn't change anything.
osmosis never gets to the limits of the raid so i think i can rule out
IO performance as well.
how do i get osmosis up to speed so it will finish in a matter of days?
More information about the dev
mailing list