[Tile-serving] [openstreetmap/osm2pgsql] possible memoryleak with 1.5.0 (#1539)

[ಠ_ಠ]

its currently creating indices for the tables, its not that slow in summary :)

```
21:14:28 » easteregg at t480 ~/osm-import $ osm2pgsql --log-level=debug --hstore-all --slim --drop --cache=20000 -G --number-processes=4 --flat-nodes=tmp -H 192.168.2.103 -U osm -d osm planet-latest.osm.pbf
2021-07-16 21:14:29  osm2pgsql version 1.4.1
2021-07-16 21:14:29  Database version: 13.3 (Debian 13.3-1)
2021-07-16 21:14:29  PostGIS version: 3.1
2021-07-16 21:14:29  Reading file: planet-latest.osm.pbf
2021-07-16 21:14:29  Allocating memory for dense node cache
2021-07-16 21:14:29  Allocating dense node cache in one big chunk
2021-07-16 21:14:29  Allocating memory for sparse node cache
2021-07-16 21:14:29  Sharing dense sparse
2021-07-16 21:14:29  Node-cache: cache=20000MB, maxblocks=320000*65536, allocation method=11
2021-07-16 21:14:29  Mid: loading persistent node cache from tmp
2021-07-16 21:14:29  Mid: pgsql, cache=20000
2021-07-16 21:14:29  Setting up table 'planet_osm_nodes'
2021-07-16 21:14:29  Setting up table 'planet_osm_ways'
2021-07-16 21:14:30  Setting up table 'planet_osm_rels'
2021-07-16 21:14:30  Using projection SRS 3857 (Spherical Mercator)
2021-07-16 21:14:30  Using built-in tag transformations
2021-07-16 21:14:30  Setting up table 'planet_osm_point'
2021-07-16 21:14:30  Setting up table 'planet_osm_line'
2021-07-16 21:14:31  Setting up table 'planet_osm_polygon'
2021-07-16 21:14:31  Setting up table 'planet_osm_roads'
2021-07-17 18:36:59  Reading input files done in 76948s (21h 22m 28s).        1.5/s)
2021-07-17 18:36:59    Processed 7041839672 nodes in 1231s (20m 31s) - 5720k/s
2021-07-17 18:36:59    Processed 782228827 ways in 52584s (14h 36m 24s) - 15k/s
2021-07-17 18:36:59    Processed 9054640 relations in 23133s (6h 25m 33s) - 391/s
2021-07-17 18:36:59  Starting pool with 4 threads.
2021-07-17 18:36:59  Dropping table 'planet_osm_nodes'
2021-07-17 18:36:59  Done postprocessing on table 'planet_osm_nodes' in 0s
2021-07-17 18:36:59  Dropping table 'planet_osm_ways'
2021-07-17 18:37:02  Done postprocessing on table 'planet_osm_ways' in 3s
2021-07-17 18:37:02  Dropping table 'planet_osm_rels'
2021-07-17 18:37:02  Done postprocessing on table 'planet_osm_rels' in 0s
2021-07-17 18:37:02  Clustering table 'planet_osm_point' by geometry...
2021-07-17 18:37:02  Clustering table 'planet_osm_line' by geometry...
2021-07-17 18:37:02  Clustering table 'planet_osm_roads' by geometry...
2021-07-17 18:37:02  Clustering table 'planet_osm_polygon' by geometry...
2021-07-17 18:37:02  Using native order for clustering table 'planet_osm_line'
2021-07-17 18:37:02  Using native order for clustering table 'planet_osm_point'
2021-07-17 18:37:02  Using native order for clustering table 'planet_osm_polygon'
2021-07-17 18:37:02  Using native order for clustering table 'planet_osm_roads'
2021-07-17 18:52:50  Creating geometry index on table 'planet_osm_roads'...
2021-07-17 18:58:21  Analyzing table 'planet_osm_roads'...
2021-07-17 18:58:35  All postprocessing on table 'planet_osm_roads' done in 1293s (21m 33s).
2021-07-17 19:18:06  Creating geometry index on table 'planet_osm_point'...
2021-07-17 19:57:31  Analyzing table 'planet_osm_point'...
2021-07-17 19:57:47  All postprocessing on table 'planet_osm_point' done in 4845s (1h 20m 45s).
```

when this is done, i will retry some different options to pin down which options caused this issue.

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/1539#issuecomment-881939414
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20210717/8597377c/attachment.htm>