[Tile-serving] [openstreetmap/osm2pgsql] 1.5.0 not all objects found in planet_osm_line/polygon in their full form (#1540)

[Darafei Praliaskouski]

Green lines: sorry, I attached a screenshot that did not have them. 

Osmium: we have a second pipeline processing the same dump via `osmium export -f pg` but still need osm2pgsql for some legacy software stack.

Yes, buildings, roads and other objects present in dump are corrupted in import.

The background is normal map.

Thanks to @pnorman for replication attempt. It looks like either our setups are different or it only affects planet.

I see a pattern that often objects that share vertices get corrupted, and there is some locality in corruption in imported regions - node ID ranges? Not a distinctive range.

basemap/osm2pgsql_styles/default.style is vanilla one.

I have re-imported the planet overnight via `osm2pgsql --style basemap/osm2pgsql_styles/default.style --number-processes 32 --hstore-all --flat-nodes data/planet-latest-updated-flat-nodes --slim --drop --create data/planet-latest-updated.osm.pbf ` and can find way 852278221 in planet_osm_line.

Versions:
```
08:36:28 [gis] > select postgis_full_version();
┌────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│                                                                                                                      postgis_full_version                                                                                                                      │
├────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┤
│ POSTGIS="3.2.0dev 3.1.0rc1-325-g13634f91f" [EXTENSION] PGSQL="130" GEOS="3.10.0dev-CAPI-1.15.0" SFCGAL="1.3.8" PROJ="7.2.1" GDAL="GDAL 3.2.2, released 2021/03/05" LIBXML="2.9.10" LIBJSON="0.15" LIBPROTOBUF="1.3.3" WAGYU="0.5.0 (Internal)" TOPOLOGY RASTER │
└────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
(1 row)

Time: 1598,717 ms (00:01,599)
08:37:24 [gis] > select version();
┌─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│                                                           version                                                           │
├─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┤
│ PostgreSQL 13.3 (Ubuntu 13.3-1.pgdg21.04+1) on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 10.3.0-1ubuntu1) 10.3.0, 64-bit │
└─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
(1 row)

Time: 0,447 ms
```

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/1540#issuecomment-882257424
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20210718/78f6e33f/attachment-0001.htm>