[Tile-serving] [openstreetmap/osm2pgsql] Update stuck waiting for postgresql "COPY ... FROM STDIN" to finish (#1273)

[mtmail]

Database is local on NVMe drive, connection via socket.

The update continued after 28 hours, unclear what or why caused it to continue. Then the next 3 updates took 2-3 hours. Now on the 4th update (1.1GB *.osc file) it hangs again for 12 hours.

Full pg stat output, I hope it's readable.
[full_pg_stat_activity.txt](https://github.com/openstreetmap/osm2pgsql/files/5248547/full_pg_stat_activity.txt)

Stack trace of the postgresql process taking 100% CPU
[postgresql-process-stack-trace.txt](https://github.com/openstreetmap/osm2pgsql/files/5248560/postgresql-process-stack-trace.txt)

I agree it looks like something is waiting for a COPY to finish (`iotop` reports no reading). And in Postgresql it runs a read on the file.

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/1273#issuecomment-695120675
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20200918/12aff9d3/attachment.htm>