[Tile-serving] [openstreetmap/osm2pgsql] Drop slim mode tables just after finishing processing pending ways an… (#612)
Paul Norman
notifications at github.com
Sat Dec 24 11:07:55 UTC 2016
I ran a test import with this PR, and the commit before it
Import flags were `--cache 34500 --flat-nodes nodes.bin --slim` with a 161212 planet. The machine had 64GB RAM, vm.swappiness=20, and very fast NVMe drives
```
master PR
time 15:54:26 15:48:21
processing time 17650s 16641s
pending ways 6803s 6822s
indexing poly 14238s 13028s
indexing ways 32795s 33414s
Max res size 36.90 GB 36.87
```
No big differences, but but Munin is more interesting. Master is to the left, PR to the right.

Just for reference, DB size is below on the same time scale

I could retry with swap disabled, but there's not much indication of memory differences with this testing.
Because with this much ram the node cache is unused, it probably all went out to swap.
--
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/pull/612#issuecomment-269079976
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20161224/e0e0174f/attachment.html>
More information about the Tile-serving
mailing list