[Tile-serving] [openstreetmap/osm2pgsql] Improve the human readility of the `osm2pgsql-replication` (PR #1975)

[Amanda]

A handful of minor improvements to the `osm2pgsql-replication` output in this PR.

Here's what the (new) output looks like. changed lines in **bold**:

2023-06-15 11:48:39 [INFO]: Using replication service 'https://planet.openstreetmap.org/replication/minute/'.
**2023-06-15 11:48:39 [INFO]: Local database is at sequence 5619810, which is data up until 5 minute(s) ago (354 seconds ago, 2023-06-15T09:42Z).**
**2023-06-15 11:48:39 [INFO]:  Remote server is at sequence 5619815, which is data up until <1 minute ago (54 seconds ago, 2023-06-15T09:47Z).**
**2023-06-15 11:48:39 [INFO]: There are 5 sequence(s) on the remote server which will be applied locally. This represents 5 minute(s) (300 sec) of changes.**
2023-06-15 11:48:40  osm2pgsql version 1.4.1
2023-06-15 11:48:40  Database version: 12.9 (Ubuntu 12.9-0ubuntu0.20.04.1)
2023-06-15 11:48:40  PostGIS version: 3.0
2023-06-15 11:48:40  Node-cache: cache=800MB, maxblocks=12800*65536, allocation method=11
2023-06-15 11:48:40  Setting up table 'planet_osm_point'
2023-06-15 11:48:40  Setting up table 'planet_osm_line'
2023-06-15 11:48:40  Setting up table 'planet_osm_polygon'
2023-06-15 11:48:40  Setting up table 'planet_osm_roads'
[324B blob data]
2023-06-15 11:48:57    Processed 14086 nodes in 3s - 5k/s
2023-06-15 11:48:57    Processed 1526 ways in 5s - 305/s
2023-06-15 11:48:57    Processed 78 relations in 9s - 9/s
2023-06-15 11:48:58  Going over 725 pending ways (using 4 threads)
[66B blob data]
2023-06-15 11:49:00  Processing 725 pending ways took 2s at a rate of 362.50/s
2023-06-15 11:49:00  Going over 146 pending relations (using 4 threads)
[66B blob data]
2023-06-15 11:49:02  Processing 146 pending relations took 2s at a rate of 73.00/s
2023-06-15 11:49:02  node cache: stored: 13297(100.00%), storage efficiency: 45.84% (dense blocks: 1, sparse nodes: 10408), hit rate: 1.61%
2023-06-15 11:49:02  osm2pgsql took 22s overall.
**2023-06-15 11:49:03 [INFO]: Data imported until 2023-06-15T09:47Z. Backlog remaining: 1 minute(s)**
**2023-06-15 11:49:03 [INFO]: It took <1 minute (23 sec) to apply 5 minute(s) (300 sec) of changes. this is a speed of ×12.9.**

You can view, comment on, or merge this pull request online at:

  https://github.com/openstreetmap/osm2pgsql/pull/1975

-- Commit Summary --

  * Improve human-readability of logging output in replication
  * Improve human readabilty of output: Show the local & remote status of replication
  * Improve human readabilty of output: print how long it took to apply how many changes, and print the rate

-- File Changes --

    M scripts/osm2pgsql-replication (46)

-- Patch Links --

https://github.com/openstreetmap/osm2pgsql/pull/1975.patch
https://github.com/openstreetmap/osm2pgsql/pull/1975.diff

-- 
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/pull/1975
You are receiving this because you are subscribed to this thread.

Message ID: <openstreetmap/osm2pgsql/pull/1975 at github.com>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20230615/e349b5c1/attachment.htm>