[Tile-serving] [osm2pgsql-dev/osm2pgsql] Daylight Ingest and Slow Deletions (Discussion #2088)

[mboeringa]

> I've been running an ingest of the Daylight v1.30 release (including a buildings sidecar that has been merged into the planet file )which has a ton more buildings in it than previous releases.

> Ah thanks, I'll try again with more (previous run was on a r5.8xl with 256 GB RAM).

@pyoung-sc Not to side track this discussion, but could you explain how you merged your 1.2 billion building sidecar (99 GB) into the planet file? The official daylight page recommends [using osmium](https://daylightmap.org/buildings.html). However, I tried to do this on a machine with >400 GB RAM available on Ubuntu 22.04, and osmium crashed, including the Terminal window I ran it in, likely when it hit the maximum RAM available, as I saw it go over >300 GB RAM last time I checked.

This makes me wonder how you managed to merge those gigantic files on a system with just 256 GB?





-- 
Reply to this email directly or view it on GitHub:
https://github.com/osm2pgsql-dev/osm2pgsql/discussions/2088#discussioncomment-7221598
You are receiving this because you are subscribed to this thread.

Message ID: <osm2pgsql-dev/osm2pgsql/repo-discussions/2088/comments/7221598 at github.com>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20231008/ffe3891b/attachment.htm>