[Tile-serving] [openstreetmap/osm2pgsql] --append is not working properly (data is deleted when it shouldn't) (#938)

[crnm21]

I'm reopening this as I experience the exact same behaviour.

I have two tileservers running in parallel and both loose data during appends - but: not the same data. One looses polygon X while the other looses polygon Y. (Both update on the exact same times).

No postgresql errors logged. Osm2pgsql runs through without error.

System: Ubuntu 18.04. Postgresql 10, Postgis 2.4.3. (POSTGIS="2.4.3 r16312" PGSQL="100" GEOS="3.6.2-CAPI-1.10.2 4d2925d6" PROJ="Rel. 4.9.3, 15 August 2016" GDAL="GDAL 2.2.3, released 2017/11/20" LIBXML="2.9.4" LIBJSON="0.12.1" LIBPROTOBUF="1.2.1" RASTER)

Im using osmupdate --day (from osmtools) with biweekly updates but experienced the same behaviour whilst using osmosis). osm2pgsql is using a flatnode file. I (other than timautin) don't use multi-geometry.

The problem exists with osm2pgsql 0.94.
Now I do testing on another server where I use osm2pgsql 1.2.0 with Libosmium 2.15.4 and Lua 5.2.4.
And I'm seeing the problem again. Again no postgresql errors, but some polygons go amiss (normally I see this with large polygons like big lakes, countries and the like but it may occur on smaller areas as well - those are just not as easily to be seen).
I've contacted timautin as well and he is still experiencing the same erratic behaviour while updating through --append.

The flatnode file is fine, the state.txt where fine as well when I used osmosis, with osmupdate I use Midnight UTC as a param with the last updates date.

Could you give me any hints on how to best debug this odd behaviour?

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/938#issuecomment-578097223
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20200124/b224b504/attachment.htm>