[Tile-serving] [osm2pgsql] Indexes Failed to Create With Large Data Load (Windows) (#494)

[Andrew]

Correct, the indexes built for the geofabrik's extract of Africa (which is smaller). 
Is there a more recent build for windows? Is there a place where users can post their builds?  Maybe I am not using the latest.

I am using PostGRES 9.3 for my DB.  I have roughly 500 GB free HDD space, so I think that is not an issue.  32 GB of RAM, so it's not a memory issue....

Here is the message output from the command window:

C:\data>osm2pgsql.exe --slim --extra-attributes --hstore-all
 -d asia -c -l -S c:\osm2pgsql\default.style -U gis asia-latest.osm.pbf
osm2pgsql SVN version 0.89.0-dev (64bit id space)

WARNING: osm2pgsql was compiled without fork, only using one process!
Using built-in tag processing pipeline
Using projection SRS 4326 (Latlong)
Setting up table: planet_osm_point
Setting up table: planet_osm_line
Setting up table: planet_osm_polygon
Setting up table: planet_osm_roads
Allocating memory for sparse node cache
Node-cache: cache=800MB, maxblocks=12800*65536, allocation method=9
Mid: pgsql, scale=10000000 cache=800
Setting up table: planet_osm_nodes
Setting up table: planet_osm_ways
Setting up table: planet_osm_rels

Reading in file: asia-latest.osm.pbf
Using PBF parser.
Processing: Node(455469k 39.1k/s) Way(45955k 1.11k/s) Relation(394930 15.81/s)
parse time: 77920s
Node stats: total(455469977), max(3813186682) in 11658s
Way stats: total(45955671), max(377910487) in 41282s
Relation stats: total(394935), max(5634238) in 24980s
Committing transaction for planet_osm_point
Committing transaction for planet_osm_line
Committing transaction for planet_osm_polygon
Committing transaction for planet_osm_roads
Setting up table: planet_osm_nodes
Setting up table: planet_osm_ways
Setting up table: planet_osm_rels
Using built-in tag processing pipeline

Going over pending ways...
        27011193 ways are pending

Using 1 helper-processes
Finished processing 27011193 ways in 50879 sec

27011193 Pending ways took 50879s at a rate of 530.89/s
Committing transaction for planet_osm_point
Committing transaction for planet_osm_line
Committing transaction for planet_osm_polygon
Committing transaction for planet_osm_roads

Going over pending relations...
        0 relations are pending

Using 1 helper-processes
Finished processing 0 relations in 0 sec

Committing transaction for planet_osm_point
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_line
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_polygon
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_roads
WARNING:  there is no transaction in progress
Stopping table: planet_osm_nodes
Sorting data and creating indexes for planet_osm_point
Stopped table: planet_osm_nodes in 0s
Stopping table: planet_osm_ways
Building index on table: planet_osm_ways
Copying planet_osm_point to cluster by geometry finished
Creating geometry index on planet_osm_point
Creating osm_id index on planet_osm_point
Creating indexes on planet_osm_point finished
All indexes on planet_osm_point created in 1138s
Completed planet_osm_point
Sorting data and creating indexes for planet_osm_line
Copying planet_osm_line to cluster by geometry finished
Creating geometry index on planet_osm_line
Creating osm_id index on planet_osm_line
Creating indexes on planet_osm_line finished
All indexes on planet_osm_line created in 5420s
Completed planet_osm_line
Sorting data and creating indexes for planet_osm_polygon




---
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/494#issuecomment-154035274
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20151105/4d8ba7f8/attachment.html>