[Tile-serving] [openstreetmap/osm2pgsql] Parallel index creation, to minimize required time (and I/O) (#1562)

[Christian Quest]

I've experienced that outside of osm2pgsql a few years ago.

We were organizing a hackathon with large health related dataset, and provided them thru a PG instance.
Billions of lines of CSV to index with many index.
Each table was larger than the machine RAM, so creating on index after the other was re-reading everyhting from HDD.
If I remember 1 index = 15mn, but 10 index in // was only 20 mn :)

Since then, I create my index in // on the same table as far as possible, then I process the next table...

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/discussions/1562#discussioncomment-1262425
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20210831/5216eb9a/attachment.htm>