[Tile-serving] [osm2pgsql] Partitioning (#92)

[Paul Norman]

I'm showing significant speed gains from partitioning, greater than the threading branch.
With 24 processes on my test setup a europe import with 0.84.0 takes 15317s, with threading 7f282b34ba8069079a835a9569512745865d2d2b 13068s, with partitioning 3bbb617dfcc0e531465f01402bc0431a60583eb7 10967s.

The gains are in processing relations going from 3717s base to 428s partitioning, indexes going from 5737s base to 3783s partitioning.

I'm showing a minor slowdown from 2422s to 2377s for pending ways, but that could be within error, I don't have a handle on the uncertainty for that number.

---
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/92#issuecomment-26967255
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20131023/b73fc885/attachment.html>