[OSM-talk] Error: Osm2pgsql Error Importing latest Planet!! OUT of MEMORY

Saphy Mo saphyfar at yahoo.com
Wed Jul 13 09:00:19 BST 2011


Dear experts,

I tried importing whole Planet into Postgis Database using osm2pgsql.exe. After 7 days, I have got the Out of Memory error in slim mode.
RAM: 16 GB (Windows 7   64)
Harddisk 1 TB.

The command was:
osm2pgsql.exe -d Planet --latlong --slim -c -C 1500 -H localhost -P 5432 -U osm -W  -S default.style .\Planet-Latest.osm.bz2

I've got  error after 'Going over pending ways' as you see in the report below.

Please help and give me advice for solution.

thank you in advance,

regards,
Saph









------------------------------------------------------------------------------------------------------------------------------------

Report of osm2pgsql.exe:

osm2pgsql.exe -d Planet --latlong --slim -c -C 1500 -H localhost -P 543
2 -U osm -W  -S default.style .\Planet-Latest.osm.bz2
osm2pgsql SVN version 0.69-21289M

Password:
Using projection SRS 4326 (Latlong)
Setting up table: planet_osm_point
NOTICE:  table "planet_osm_point" does not exist, skipping
NOTICE:  table "planet_osm_point_tmp" does not exist, skipping
Setting up table: planet_osm_line
NOTICE:  table "planet_osm_line" does not exist, skipping
NOTICE:  table "planet_osm_line_tmp" does not exist, skipping
Setting up table: planet_osm_polygon
NOTICE:  table "planet_osm_polygon" does not exist, skipping
NOTICE:  table "planet_osm_polygon_tmp" does not exist, skipping
Setting up table: planet_osm_roads
NOTICE:  table "planet_osm_roads" does not exist, skipping
NOTICE:  table "planet_osm_roads_tmp" does not exist, skipping
Mid: pgsql, scale=10000000, cache=1500MB, maxblocks=192001*8192
Setting up table: planet_osm_nodes
*** WARNING: intarray contrib module not installed
*** The resulting database will not be usable for applying diffs.
NOTICE:  table "planet_osm_nodes" does not exist, skipping
NOTICE:  CREATE TABLE / PRIMARY KEY will create implicit index "planet_osm_nodes_pkey" for table "planet_osm_n
odes"
Setting up table: planet_osm_ways
NOTICE:  table "planet_osm_ways" does not exist, skipping
NOTICE:  CREATE TABLE / PRIMARY KEY will create implicit index "planet_osm_ways_pkey" for table "planet_osm_wa
ys"
Setting up table: planet_osm_rels
NOTICE:  table "planet_osm_rels" does not exist, skipping
NOTICE:  CREATE TABLE / PRIMARY KEY will create implicit index "planet_osm_rels_pkey" for table "planet_osm_re
ls"

!! You are running this on 32bit system, so at most
!! 3GB of RAM can be used. If you encounter unexpected
!! exceptions during import, you should try running in slim
!! mode using parameter -s.

Reading in file: .\OsmFiles\Planet-Latest.osm.bz2
Unknown node type 8
Processing: Node(1118130k) Way(97901k) Relation(819k)
Exception caught processing way id=1388172
Processing: Node(1118130k) Way(97901k) Relation(862k)
Exception caught processing way id=1440075
Processing: Node(1118130k) Way(97901k) Relation(898k)
Exception caught processing way id=1479960
Processing: Node(1118130k) Way(97901k) Relation(1019k)
Node stats: total(1118130701), max(1325889367)
Way stats: total(97901806), max(117747569)
Relation stats: total(1019004), max(1625305)

Going over pending ways
processing way (25977k)way_done failed: ERROR:  out of memory
DETAIL:  Failed on request of size 419430400.
(7)
Arguments were: 75141421,
Error occurred, cleaning up

C:\Cartography\MapnikShop\OsmToPgsql>ECHO "Finished at:"  12.07.2011   22:48:40,73
"Finished at:"  12.07.2011   22:48:40,73

C:\Cartography\MapnikShop\OsmToPgsql>Pause
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/talk/attachments/20110713/001d0296/attachment.html>


More information about the talk mailing list