[Tile-serving] [osm2pgsql-dev/osm2pgsql] Daylight Ingest and Slow Deletions (Discussion #2088)

[pyoung-sc]

For posterity, here's the stats from an import in RDS with daylight 1.32:
```
2023-10-19 05:42:54    Processed 12427938028 nodes in 1887s (31m 27s) - 6586k/s
2023-10-19 05:42:54    Processed 1779505585 ways in 23307s (6h 28m 27s) - 76k/s
2023-10-19 05:42:54    Processed 10383411 relations in 88857s (24h 40m 57s) - 117/s
2023-10-19 05:42:54  Reprocess marked ways (stage 2)...
2023-10-19 05:42:57  Creating id index on table 'planet_osm_line'...
2023-10-19 07:00:39  Creating id index on table 'planet_osm_polygon'...
2023-10-19 07:18:59  Creating id index on table 'planet_osm_roads'...
2023-10-19 08:32:17  Creating id indexes took 10162s (2h 49m 22s)
2023-10-19 08:32:17  There are 3064634 ways to reprocess...
2023-10-19 11:01:14  Clustering table 'planet_osm_point' by geometry...
2023-10-19 11:01:18  Done postprocessing on table 'planet_osm_nodes' in 0s
2023-10-19 11:01:18  Building index on table 'planet_osm_rels'
2023-10-19 11:01:18  Building index on table 'planet_osm_ways'
2023-10-19 11:01:20  Clustering table 'planet_osm_polygon' by geometry...
2023-10-19 11:01:20  Clustering table 'planet_osm_line' by geometry...
2023-10-19 11:01:20  Clustering table 'planet_osm_roads' by geometry...
2023-10-19 11:33:39  Creating index on table 'planet_osm_point' ("way")...
2023-10-19 11:43:13  Creating id index on table 'planet_osm_point'...
2023-10-19 11:44:23  Analyzing table 'planet_osm_point'...
2023-10-19 19:10:43  Creating index on table 'planet_osm_polygon' ("way")...
2023-10-19 20:51:19  Creating id index on table 'planet_osm_polygon'...
2023-10-19 21:16:44  Analyzing table 'planet_osm_polygon'...
2023-10-19 21:32:26  Done postprocessing on table 'planet_osm_ways' in 37868s (10h 31m 8s)
2023-10-19 21:32:26  Done postprocessing on table 'planet_osm_rels' in 271s (4m 31s)
2023-10-19 21:32:26  All postprocessing on table 'planet_osm_point' done in 2592s (43m 12s).
2023-10-20 20:39:15  Creating index on table 'planet_osm_roads' ("way")...
2023-10-20 21:28:06  Creating index on table 'planet_osm_line' ("way")...
2023-10-21 03:24:32  Creating id index on table 'planet_osm_roads'...
2023-10-21 04:09:32  Analyzing table 'planet_osm_roads'...
2023-10-21 04:38:26  Creating id index on table 'planet_osm_line'...
2023-10-21 05:29:12  Analyzing table 'planet_osm_line'...
2023-10-21 05:29:14  All postprocessing on table 'planet_osm_line' done in 152883s (42h 28m 3s).
2023-10-21 05:29:14  All postprocessing on table 'planet_osm_polygon' done in 36942s (10h 15m 42s).
2023-10-21 05:29:14  All postprocessing on table 'planet_osm_roads' done in 148103s (41h 8m 23s).
2023-10-21 05:29:14  Storing properties to table '"public"."osm2pgsql_properties"'.
2023-10-21 05:29:14  osm2pgsql took 286031s (79h 27m 11s) overall.
```

-- 
Reply to this email directly or view it on GitHub:
https://github.com/osm2pgsql-dev/osm2pgsql/discussions/2088#discussioncomment-7360138
You are receiving this because you are subscribed to this thread.

Message ID: <osm2pgsql-dev/osm2pgsql/repo-discussions/2088/comments/7360138 at github.com>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20231023/4ed12125/attachment.htm>