[Tile-serving] [openstreetmap/osm2pgsql] Osm2psql needs too much memory for parsing with libosmium (#574)

[Fabrício Zimmerer Murta]

I'm not sure this adds up to anything but trying to restore [a NA extract from geofabrik.de](https://download.geofabrik.de/north-america.html), with these flags:
`--create --username osm --database osm_na --prefix "na" --number-processes 8 --latlong --cache 16384 --hstore-all north-america-latest.osm.pbf`

And getting the process killed by using all memory. 64GB physical + 8Gb swap.

Dmesg tells me this at the point it kills it:

```
[13678037.288635] Out of memory: Kill process 5913 (osm2pgsql) score 949 or sacrifice child
[13678037.288698] Killed process 5913 (osm2pgsql) total-vm:75500368kB, anon-rss:63322932kB, file-rss:0kB, shmem-rss:0kB
```
So unmistakably it uses all RAM to process that 8GB file. I may be overusing the import flags, maybe, but no matter what, it looks to me a much higher ram usage than what it should. I'll try resorting to the flat file.

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/574#issuecomment-445429140
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20181207/db0c0055/attachment-0001.html>