[Tile-serving] [osm2pgsql] bad result during COPY (#159)

[nahamada]

Hello,

I cloned Osm2pgsql from github and tried to import some data with it. It worked fine with a for Belgium and Luxembourg extract, so i decided to increase the size to the Netherlands (extract from http://download.geofabrik.de/ ).

It when bad from here: it crash after processing 90M nodes , but no ways or relations


```
./osm2pgsql -l -x -v  --number-processes 4  --cache-strategy sparse -p carto_ne  --style default.style -d carto -s -H <host>  -U <User> download/netherlands-latest.osm.pbf                                                                                                  
osm2pgsql SVN version 0.85.0 (64bit id space)                                                                                                                          

Using projection SRS 4326 (Latlong)
Setting up table: carto_ne_point   
NOTICE:  table "carto_ne_point" does not exist, skipping
NOTICE:  table "carto_ne_point_tmp" does not exist, skipping
Setting up table: carto_ne_line                             
NOTICE:  table "carto_ne_line" does not exist, skipping     
NOTICE:  table "carto_ne_line_tmp" does not exist, skipping 
Setting up table: carto_ne_polygon                          
NOTICE:  table "carto_ne_polygon" does not exist, skipping  
NOTICE:  table "carto_ne_polygon_tmp" does not exist, skipping
Setting up table: carto_ne_roads                              
NOTICE:  table "carto_ne_roads" does not exist, skipping      
NOTICE:  table "carto_ne_roads_tmp" does not exist, skipping  
Using built-in tag processing pipeline                        
Allocating memory for sparse node cache                       
Node-cache: cache=800MB, maxblocks=102400*8192, allocation method=9
Mid: pgsql, scale=10000000 cache=800                               
Setting up table: carto_ne_nodes                                   
NOTICE:  table "carto_ne_nodes" does not exist, skipping           
NOTICE:  CREATE TABLE / PRIMARY KEY will create implicit index "carto_ne_nodes_pkey" for table "carto_ne_nodes"
Setting up table: carto_ne_ways                                                                                
NOTICE:  table "carto_ne_ways" does not exist, skipping                                                        
NOTICE:  CREATE TABLE / PRIMARY KEY will create implicit index "carto_ne_ways_pkey" for table "carto_ne_ways"  
Setting up table: carto_ne_rels                                                                                
NOTICE:  table "carto_ne_rels" does not exist, skipping                                                        
NOTICE:  CREATE TABLE / PRIMARY KEY will create implicit index "carto_ne_rels_pkey" for table "carto_ne_rels"  

Reading in file: download/netherlands-latest.osm.pbf
Processing: Node(94050k 26.1k/s) Way(0k 0.00k/s) Relation(0 0.00/s) 
carto_ne_line - bad result during COPY, data 4009112    \N      \N      \N      \N      \N      \N      \N      \N      \N      \N      \N      \N      \N      \N     \N       \N      \N      \N      \N      \N      \N      \N      yes     \N      \N      footway \N      \N      \N      \N      \N      \N      \N      \N      \N     \N       \N      Lijnpadstraat   \N      \N      \N      \N      \N      \N      \N      \N      \N      \N      \N      \N      \N      \N      \N      \N      \N     \N       \N      \N      \N      \N      \N      \N      \N      \N      \N      0       \N      \N      \N      \N      \N      3       \N      SRID=4326;LINESTRING (5.1221357000000003 52.0801506999999972, 5.1218190000000003 52.0802778999999987)                                                                                           

Error occurred, cleaning up
```

I checked the MD5, ok. When I tried again, it is now stuck on 
NOTICE:  table "carto_ne_line_tmp" does not exist, skipping

After posting to the mailing list, they advice me to drop the db and retry without cache-strategy (I add flat-nodes for space trouble), but got the same issue.

I'm running on CentOS 6.4, and PostGres 9.0.6 for the database.
The PostGIS_full_version() is "POSTGIS="1.5.3" GEOS="3.3.0-CAPI-1.7.0" PROJ="Rel. 4.7.1, 23 September 2009" LIBXML="2.6.26" USE_STATS"

Hope this will help.

Nourdine.

---
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/159
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20140617/2772fcba/attachment.html>