[Tile-serving] [osm2pgsql] Convert geometries to WKB instead of WKT (#511)

Sarah Hoffmann notifications at github.com
Fri Nov 27 21:40:31 UTC 2015


Changes geometry-builder to emit WKBs. Nodes are still built as WKTs at the moment.
Improves performance by 15-20%.

Planet import with `./osm2pgsql -d gis -S ../default.style --flat-nodes osm2pgsql.flatnodes -s -C 24000 --drop planet-150624.osm.pbf` on 32GB RAM all-SSD system with 6x2 CPUs yields:

master:
```
Node stats: total(2926993226), max(3610010794) in 1064s
Way stats: total(295111882), max(355378385) in 12100s
Relation stats: total(3493735), max(5307354) in 15387s
Pending ways took 9523s at a rate of 20389.88/s
Osm2pgsql took 55724s overall
```

use-wkb brnach:
```
Node stats: total(2926993226), max(3610010794) in 1065s
Way stats: total(295111882), max(355378385) in 9093s
Relation stats: total(3493735), max(5307354) in 11710s
Pending ways took 8320s at a rate of 23338.07/s
Osm2pgsql took 48452s overall
```

You can view, comment on, or merge this pull request online at:

  https://github.com/openstreetmap/osm2pgsql/pull/511

-- Commit Summary --

  * replace WKTWriter with WKBWriter
  * replace WKTReader with WKBReader
  * explicitly save geometry type in wkt

-- File Changes --

    M expire-tiles.cpp (14)
    M expire-tiles.hpp (2)
    M geometry-builder.cpp (50)
    M geometry-builder.hpp (13)
    M output-gazetteer.cpp (3)
    M output-multi.cpp (4)
    M output-pgsql.cpp (8)
    M processor-point.cpp (2)
    M table.cpp (43)
    M table.hpp (47)

-- Patch Links --

https://github.com/openstreetmap/osm2pgsql/pull/511.patch
https://github.com/openstreetmap/osm2pgsql/pull/511.diff

---
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/pull/511
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20151127/5b59364d/attachment.html>


More information about the Tile-serving mailing list