[Tile-serving] [openstreetmap/osm2pgsql] Potential memory leak when running without flatnode option (#931)

[timautin]

Hi @pnorman ,

I retried with:

```
synchronous_commit = off
fsync = off
random_page_cost = 1.1
wal_buffers = 16MB
effective_cache_size = 48GB
maintenance_work_mem = 8GB
shared_buffers = 16GB
work_mem = 1GB
autovacuum = on
effective_io_concurrency = 200
max_connections = 300
checkpoint_completion_target = 0.7
default_statistics_target = 100
min_wal_size = 1GB
max_wal_size = 4GB
max_worker_processes = 16
max_parallel_workers_per_gather = 8
max_parallel_workers = 16
```

and

time osm2pgsql \
    -d osm \
    --create --slim -G --hstore \
    -C 20000 \
    --number-processes 1 \
    --tag-transform-script ~/src/map-styles/openstreetmap-carto/openstreetmap-carto.lua \
    --style ~/src/map-styles/openstreetmap-carto/openstreetmap-carto.style \
    planet-latest.osm.pbf \
    --flat-nodes /ssd/flat-nodes/osm.cache

And it worked, respecting the 20GB limit.

I found this in the kern.log:

```
May 25 13:41:46 EX62 kernel: [100019.247398] Out of memory: Kill process 18243 (osm2pgsql) score 992 or sacrifice child
May 25 13:41:46 EX62 kernel: [100019.247558] Killed process 18243 (osm2pgsql) total-vm:112168708kB, anon-rss:64966476kB, file-rss:0kB, shmem-rss:0kB
May 25 13:41:49 EX62 kernel: [100022.248592] oom_reaper: reaped process 18243 (osm2pgsql), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
```
Not sur if that helps??

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/931#issuecomment-497120661
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20190529/1d06f0fb/attachment.html>