[Tile-serving] [osm2pgsql] Import 'Killed' every time while 'Going over pending ways...' (#218)

[Michael Prentice]

The nodes won't fit into memory using 12 GB or 15 GB. So the planet guides that suggest that 14 GBs is doable need to be updated. Including the one that you suggested (http://switch2osm.org/loading-osm-data/).

I am now using your suggested guide which seems to be more detailed and include some extra steps. There are also some steps that the other guide has that this one does not (like testing after import and troubleshooting). So I'll be referring to both.

I've re-created my VM with 32 GB of RAM now so that I can hopefully get this to work. Using 18 GB of RAM for caching on a 24 GB machine does not work because computing paths gets killed by the memory manager. Using 15 GB of RAM for caching does not work because not all of the nodes can be loaded into memory. There may be a sweet spot somewhere between 15-18 GB of RAM, but it is unlikely. I would suggest that the minimum memory for a planet map server recommendation should be increased to 28-32 GBs of RAM minimum.

My current running command is here:

`osm2pgsql --slim --flat-nodes /map-data/osm/flat_nodes.bin -C 20000 --number-processes 7 --style /map-data/osm/openstreetmap-carto/openstreetmap-carto.style planet-141126.osm.pbf`

---
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/218#issuecomment-68006897
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20141223/2e2bf816/attachment.html>