[Tile-serving] [openstreetmap/osm2pgsql] Update failure with flex backend (#1080)

[Andy Allan]

I've just tested updates for the first time, and it failed with the error:

```
Prepared statement failed with: insufficient data in "T" message
 (7)
Query: get_wkb
with arguments:
  0: 753776584
```
osm2pgsql then appears to hang.

This was for 2 minutes worth of diffs, namely 

```
#Sun Dec 08 23:30:03 UTC 2019
sequenceNumber=3794211
txnMaxQueried=2470191311
txnActiveList=
txnReadyList=
txnMax=2470191311
timestamp=2019-12-08T23\:30\:02Z
```
and a maxInterval = 120 in the osmosis configuration. Full output:

```
osm2pgsql version 1.2.0 (1.2.0-252-g28e5d37) (64 bit id space)

Allocating memory for dense node cache
Allocating dense node cache in one big chunk
Allocating memory for sparse node cache
Sharing dense sparse
Node-cache: cache=8000MB, maxblocks=128000*65536, allocation method=11
Mid: loading persistent node cache from /home/data/postgres-fast/node-cache/node.cache
Mid: pgsql, cache=8000
osm2pgsql version: 1.2.0
osm2pgsql mode: append
Using projection SRS 3857 (Spherical Mercator)

Reading in file: -
Using XML parser.
Feb 20, 2020 10:07:54 AM org.openstreetmap.osmosis.core.Osmosis run
INFO: Osmosis Version 0.39
Feb 20, 2020 10:07:54 AM org.openstreetmap.osmosis.core.Osmosis run
INFO: Preparing pipeline.
Feb 20, 2020 10:07:54 AM org.openstreetmap.osmosis.core.Osmosis run
INFO: Launching pipeline execution.
Feb 20, 2020 10:07:54 AM org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline executing, waiting for completion.
Feb 20, 2020 10:07:55 AM org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline complete.
Feb 20, 2020 10:07:55 AM org.openstreetmap.osmosis.core.Osmosis run
INFO: Total execution time: 1601 milliseconds.
  parse time: 4s
Node stats: total(1258), max(7042636290) in 1s
Way stats: total(279), max(753776584) in 1s
Relation stats: total(2), max(9733660) in 0s

Going over pending ways...
        258 ways are pending

Using 6 helper-processes
Left to process: 252...Prepared statement failed with: insufficient data in "T" message
 (7)
Query: get_wkb
with arguments:
  0: 753776584
Left to process: 0...
```

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/1080
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20200225/72f02fca/attachment.htm>