[OSM-dev] osm2pgSQL: bad result during COPY

[Nourdine Ahamada]

Hello,

I cloned Osm2pgsql from github and tried to import some data with it. It
worked fine with a small extract, so i decided to increase the size to the
Netherlands, with extract from http://download.geofabrik.de/ .

It when bad from here: it crash after processing 90M nodes , but no ways or
relations

./osm2pgsql -l -x -v  --number-processes 4  --cache-strategy sparse -p
carto_ne  --style default.style -d carto -s -H <host>  -U <User>
download/netherlands-latest.osm.pbf

osm2pgsql SVN version 0.85.0 (64bit id space)



Using projection SRS 4326 (Latlong)
Setting up table: carto_ne_point
NOTICE:  table "carto_ne_point" does not exist, skipping
NOTICE:  table "carto_ne_point_tmp" does not exist, skipping
Setting up table: carto_ne_line
NOTICE:  table "carto_ne_line" does not exist, skipping
NOTICE:  table "carto_ne_line_tmp" does not exist, skipping
Setting up table: carto_ne_polygon
NOTICE:  table "carto_ne_polygon" does not exist, skipping
NOTICE:  table "carto_ne_polygon_tmp" does not exist, skipping
Setting up table: carto_ne_roads
NOTICE:  table "carto_ne_roads" does not exist, skipping
NOTICE:  table "carto_ne_roads_tmp" does not exist, skipping
Using built-in tag processing pipeline
Allocating memory for sparse node cache
Node-cache: cache=800MB, maxblocks=102400*8192, allocation method=9
Mid: pgsql, scale=10000000 cache=800
Setting up table: carto_ne_nodes
NOTICE:  table "carto_ne_nodes" does not exist, skipping
NOTICE:  CREATE TABLE / PRIMARY KEY will create implicit index
"carto_ne_nodes_pkey" for table "carto_ne_nodes"
Setting up table: carto_ne_ways

NOTICE:  table "carto_ne_ways" does not exist, skipping

NOTICE:  CREATE TABLE / PRIMARY KEY will create implicit index
"carto_ne_ways_pkey" for table "carto_ne_ways"
Setting up table: carto_ne_rels

NOTICE:  table "carto_ne_rels" does not exist, skipping

NOTICE:  CREATE TABLE / PRIMARY KEY will create implicit index
"carto_ne_rels_pkey" for table "carto_ne_rels"

Reading in file: download/netherlands-latest.osm.pbf
Processing: Node(94050k 26.1k/s) Way(0k 0.00k/s) Relation(0 0.00/s)
carto_ne_line - bad result during COPY, data 4009112    \N      \N      \N
     \N      \N      \N      \N      \N      \N      \N      \N      \N
 \N      \N     \N       \N      \N      \N      \N      \N      \N      \N
     yes     \N      \N      footway \N      \N      \N      \N      \N
 \N      \N      \N      \N     \N       \N      Lijnpadstraat   \N      \N
     \N      \N      \N      \N      \N      \N      \N      \N      \N
 \N      \N      \N      \N      \N      \N     \N       \N      \N      \N
     \N      \N      \N      \N      \N      \N      0       \N      \N
 \N      \N      \N      3       \N      SRID=4326;LINESTRING
(5.1221357000000003 52.0801506999999972, 5.1218190000000003
52.0802778999999987)


Error occurred, cleaning up


I checked the MD5, ok. When I tried again, it is now stuck on
NOTICE:  table "carto_ne_line_tmp" does not exist, skipping

The only thing Google told me about that error is to check the encoding
(UTF8, wich is OK), so I'm looking for a little help.
I'm running on CentOS 6.4, and PostGres 9.0.6 for the database.

Greetings,

Nourdine
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20140616/4edc251c/attachment.html>