[OSM-dev] osm2pgsql: Unable to import planet

Sven Geggus lists at fuchsschwanzdomain.de
Mon Jan 12 10:37:13 UTC 2015


Hello,

unfortunately I'm unable to import current planet files using osm2pgsql.
This might be a psql issue because the strange error message I get seems to
come from postgress rather than osm2pgsql:

osm2pgsql -U postgres -s --number-processes=8 -C4000 -S hstore-match-only.style --flat-nodes /tmp/flatnodefile --hstore --hstore-match-only -d digmt planet-150105.osm.pbf
osm2pgsql SVN version 0.87.1 (64bit id space)

Using built-in tag processing pipeline
Using projection SRS 900913 (Spherical Mercator)
Setting up table: planet_osm_point
Setting up table: planet_osm_line
Setting up table: planet_osm_polygon
Setting up table: planet_osm_roads
Allocating memory for dense node cache
Allocating dense node cache in one big chunk
Allocating memory for sparse node cache
Sharing dense sparse
Node-cache: cache=4000MB, maxblocks=512000*8192, allocation method=11
Mid: loading persistent node cache from /tmp/flatnodefile
Allocated space for persistent node cache file
Maximum node in persistent node cache: 0
Mid: pgsql, scale=100 cache=4000
Setting up table: planet_osm_nodes
Setting up table: planet_osm_ways
Setting up table: planet_osm_rels

Reading in file: planet-150105.osm.pbf
Processing: Node(2672693k 1631.7k/s) Way(267143k 7.32k/s) Relation(2297370
57.27/s)Maximum node in persistent node cache: 3270508543
node cache: stored: 499159094(18.68%), storage efficiency: 95.21% (dense
blocks: 463882, sparse nodes: 24636458), hit rate: 13.42%
Osm2pgsql failed due to ERROR: get_way_list failed: FEHLER:  invalid memory alloc request size 18446744073709551613
(7)
Arguments were:
{158316322,37669753,156819792,156819720,245694537,156819742,158316324,126760837,95242622,95242612,31404881,158316333,29171707,26142674,37626540,29178874,26202582,29020170,57208434,57208429,26142794,29200328,29200230,293588151,29200312,29070293,24277202,34616458,24277204,61594153,158316940,158316941,158316934,35878683,35147653,57737110,158316942,26963683,57737104,95351513,95351552,95351505,95351547,95351519,95351544,35998299,158316920,158316943,158316935,127949408,35999803,127949407,314868523,124719357,36824502,36887582,158319685,158319677,36826753,119960436,119960555,119960556,158319690,158319678,158319703,39432345,39432346,231742109,42071595,42071598},

Any Idea?

Sven

-- 
"linux is evolution, not intelligent design"
(Linus Torvalds)

/me is giggls at ircnet, http://sven.gegg.us/ on the Web

----- End forwarded message -----

-- 
"linux is evolution, not intelligent design"
(Linus Torvalds)

/me is giggls at ircnet, http://sven.gegg.us/ on the Web



More information about the dev mailing list