[OSM-dev] osm2pgsql killed when pending ways

[Lauri Kajan]

Hi all

I have some trouble to import osm data to my postgis database.
I am trying to import europe dump from gefabrik but the process was killed.
Is this a memory issue or something else? It took so far almost 5 days
to process.

Is there any possibilities to continue the process from the point of
the crash? Or should I start all over again?

I used latest revision 28427 of the osm2pgsql.
I have 8GB of RAM on my server and I used these configurations on my postgresql:
shared_buffers = 1024MB
work_mem = 8MB
maintenance_work_mem = 1024MB
checkpoint_segments = 20
autovacuum = off
Are these settings a way off?


And this was the command:
osm2pgsql --create --database osm --username osm --slim --cache 4096
--hstore --number-processes 2 -l --keep-coastlines europe.osm.pbf


And here is the output:

Reading in file: europe.osm.pbf
Processing: Node(715301k 126.2k/s) Way(86611k 0.36k/s) Relation(432050 5.00/s)
Standard exception processing way_id 1082366: TopologyException: side
location conflict at 7.39163 59.5756
Processing: Node(715301k 126.2k/s) Way(86611k 0.36k/s) Relation(807380 6.19/s)
Standard exception processing way_id 1792031: TopologyException: side
location conflict at -6.60196 42.5488
Processing: Node(715301k 126.2k/s) Way(86611k 0.36k/s) Relation(846270 6.31/s)
Standard exception processing way_id 1868906: TopologyException: side
location conflict at 10.9979 45.4427
Processing: Node(715301k 126.2k/s) Way(86611k 0.36k/s)
Relation(1026710 6.57/s)  parse time: 405122s

Node stats: total(715301892), max(1768935262) in 5667s
Way stats: total(86611805), max(165342172) in 243132s
Relation stats: total(1026717), max(2202768) in 156323s
Committing transaction for planet_osm_point
Committing transaction for planet_osm_line
Committing transaction for planet_osm_polygon
Committing transaction for planet_osm_roads

Going over pending ways
Killed



Thanks for the help

-Lauri