[Tile-serving] [osm2pgsql-dev/osm2pgsql] parallelize the COPY phase (Discussion #2426)

[Tomas Vondra]

Hi,

I've been doing some testing with OSM data, and I noticed that a significant part of the load is taken by COPY, which happens without parallelism. Are there any plans to parallelize this, either by loading multiple tables concurrently, or splitting the data into smaller chunks and loading them through multiple connections?

I'm not very familiar with the data structure, so maybe there are dependencies that make this impossible / inefficient. But it's a bit sad to not be able to better utilize available hardware resources.

-- 
Reply to this email directly or view it on GitHub:
https://github.com/osm2pgsql-dev/osm2pgsql/discussions/2426
You are receiving this because you are subscribed to this thread.

Message ID: <osm2pgsql-dev/osm2pgsql/repo-discussions/2426 at github.com>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20251028/e0ce3aca/attachment.htm>