[Tile-serving] [openstreetmap/osm2pgsql] Make sure cache is freed before starting indexing (#813)

[Marcos Dione]

I got this log:

```
$ nice -n 19 /home/mdione/src/projects/osm2pgsql/build/osm2pgsql --create --unlogged --username mdione --database gis --cache 1024 --number-processes 4 --verbose --slim --flat-nodes ../../nodes.cache --hstore --multi-geometry --style ../../osm-carto/openstreetmap-carto.style --tag-transform-script ../../osm-carto/openstreetmap-carto.lua --drop argentina-latest.osm.pbf
osm2pgsql version 0.95.0-dev (64 bit id space)

Using lua based tag processing pipeline with script ../../osm-carto/openstreetmap-carto.lua
Using projection SRS 3857 (Spherical Mercator)
Setting up table: planet_osm_point
Setting up table: planet_osm_line
Setting up table: planet_osm_polygon
Setting up table: planet_osm_roads
Allocating memory for dense node cache
Allocating dense node cache in one big chunk
Allocating memory for sparse node cache
Sharing dense sparse
Node-cache: cache=1024MB, maxblocks=16384*65536, allocation method=11
Mid: loading persistent node cache from ../../nodes.cache
Mid: pgsql, cache=1024
Setting up table: planet_osm_nodes
Setting up table: planet_osm_ways
Setting up table: planet_osm_rels

Reading in file: argentina-latest.osm.pbf
Using PBF parser.
Processing: Node(15260k 37.6k/s) Way(1539k 23.69k/s) Relation(33270 756.14/s)  parse time: 515s
Node stats: total(15260203), max(4818789370) in 406s
Way stats: total(1539595), max(489654503) in 65s
Relation stats: total(33522), max(7191564) in 44s
Committing transaction for planet_osm_point
Committing transaction for planet_osm_line
Committing transaction for planet_osm_polygon
Committing transaction for planet_osm_roads
Setting up table: planet_osm_nodes
Setting up table: planet_osm_ways
Setting up table: planet_osm_rels
Using lua based tag processing pipeline with script ../../osm-carto/openstreetmap-carto.lua
Setting up table: planet_osm_nodes
Setting up table: planet_osm_ways
Setting up table: planet_osm_rels
Using lua based tag processing pipeline with script ../../osm-carto/openstreetmap-carto.lua
Setting up table: planet_osm_nodes
Setting up table: planet_osm_ways
Setting up table: planet_osm_rels
Using lua based tag processing pipeline with script ../../osm-carto/openstreetmap-carto.lua
Setting up table: planet_osm_nodes
Setting up table: planet_osm_ways
Setting up table: planet_osm_rels
Using lua based tag processing pipeline with script ../../osm-carto/openstreetmap-carto.lua

Going over pending ways...
        359263 ways are pending

Using 4 helper-processes

Finished processing 359263 ways in 26 s

359263 Pending ways took 26s at a rate of 13817.81/s
Committing transaction for planet_osm_point
Committing transaction for planet_osm_line
Committing transaction for planet_osm_polygon
Committing transaction for planet_osm_roads
Committing transaction for planet_osm_point
Committing transaction for planet_osm_line
Committing transaction for planet_osm_polygon
Committing transaction for planet_osm_roads
Committing transaction for planet_osm_point
Committing transaction for planet_osm_line
Committing transaction for planet_osm_polygon
Committing transaction for planet_osm_roads
Committing transaction for planet_osm_point
Committing transaction for planet_osm_line
Committing transaction for planet_osm_polygon
Committing transaction for planet_osm_roads

Going over pending relations...
        0 relations are pending

Using 4 helper-processes
Finished processing 0 relations in 0 s

Committing transaction for planet_osm_point
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_line
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_polygon
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_roads
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_point
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_line
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_polygon
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_roads
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_point
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_line
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_polygon
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_roads
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_point
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_line
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_polygon
WARNING:  there is no transaction in progress
Committing transaction for planet_osm_roads
WARNING:  there is no transaction in progress
Mid: removing persistent node cache at ../../nodes.cache
node cache: stored: 15260203(100.00%), storage efficiency: 50.29% (dense blocks: 77, sparse nodes: 14855433), hit rate: 99.98%
Stopping table: planet_osm_nodes
Stopping table: planet_osm_ways
Stopping table: planet_osm_rels
Stopped table: planet_osm_nodes in 0s
Stopped table: planet_osm_rels in 0s
Stopped table: planet_osm_ways in 0s
Stopping table: planet_osm_nodes
Stopping table: planet_osm_ways
Stopping table: planet_osm_rels
Osm2pgsql failed due to ERROR: DROP TABLE planet_osm_nodes failed: connection pointer is NULL
```

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/pull/813#issuecomment-358317946
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20180117/1674dd6f/attachment.html>