[Tile-serving] [openstreetmap/osm2pgsql] osm2pgsql "failed to uncompress data: data error" when importing planet-osm.pbf (Issue #1582)

[dmwharris]

## What version of osm2pgsql are you using? 1.5.1

<!-- Paste output of `osm2pgsql --version` here. Please use the [latest
release](https://osm2pgsql.org/releases/) of osm2pgsql if at all
possible. -->

+ sudo -u renderer osm2pgsql -d gis --create --slim -G --hstore --tag-transform-script /home/renderer/src/openstreetmap-carto/openstreetmap-carto.lua --number-processes 24 -S /home/renderer/src/openstreetmap-carto/openstreetmap-carto.style /data.osm.pbf --flat-nodes /nodes/flat_nodes.bin
2021-11-16 20:48:31  osm2pgsql version 1.5.1
2021-11-16 20:48:31  Database version: 12.9 (Ubuntu 12.9-0ubuntu0.20.04.1)
2021-11-16 20:48:31  PostGIS version: 3.1
2021-11-16 20:48:31  Setting up table 'planet_osm_point'
2021-11-16 20:48:31  Setting up table 'planet_osm_line'
2021-11-16 20:48:31  Setting up table 'planet_osm_polygon'
2021-11-16 20:48:31  Setting up table 'planet_osm_roads'
Processing: Node(108590k 1840.5k/s) Way(0k 0.00k/s) Relation(0 0.0/s)2021-11-16 20:49:31  ERROR: failed to uncompress data: data error


## What operating system and PostgreSQL/PostGIS version are you using? Linux, PostgreSQL - 12, PostGIS-3.1

<!-- Also what Linux distribution if applicable, OS version? -->Ubuntu 20.01,


## Tell us something about your system

<!-- How much RAM do you have, how many CPUs, bare metal or cloud setup? -->
16GB, 4 CPUs running in VMware VM

## What did you do exactly?

<!-- Please provide the command(s) you used including all options etc. Include
links to input files. -->

Attempting to import planet-latest.osm.buf into a docker container per instructions at https://switch2osm.org/serving-tiles/using-a-docker-container/

renderaccount at ubuntu:/home/renderaccount/Downloads$ docker run -e THREADS=24 -e "OSM2PGSQL_EXTRA_ARGS=-C 4096" -e "OSM2PGSQL_EXTRA_ARGS=--flat-nodes /nodes/flat_nodes.bin" -v /home/renderaccount/Downloads/planet-latest.osm.pbf:/data.osm.pbf -v openstreetmap-rendered-tiles:/var/lib/mod_tile -v openstreetmap-data:/var/lib/postgresql/12/main overv/openstreetmap-tile-server import

## What did you expect to happen?

<!-- Describe in detail what you expected the above would do. -->

I expected the planet-latest.osm.buf file to be imported without errors

## What did happen instead?

<!-- Please describe what happened and why you think this is wrong. Please include
(or link to, if it is too verbose) the log output. -->

During execution of the docker command, I received the following output and error:

+ sudo -u renderer osm2pgsql -d gis --create --slim -G --hstore --tag-transform-script /home/renderer/src/openstreetmap-carto/openstreetmap-carto.lua --number-processes 24 -S /home/renderer/src/openstreetmap-carto/openstreetmap-carto.style /data.osm.pbf --flat-nodes /nodes/flat_nodes.bin
2021-11-16 20:48:31  osm2pgsql version 1.5.1
2021-11-16 20:48:31  Database version: 12.9 (Ubuntu 12.9-0ubuntu0.20.04.1)
2021-11-16 20:48:31  PostGIS version: 3.1
2021-11-16 20:48:31  Setting up table 'planet_osm_point'
2021-11-16 20:48:31  Setting up table 'planet_osm_line'
2021-11-16 20:48:31  Setting up table 'planet_osm_polygon'
2021-11-16 20:48:31  Setting up table 'planet_osm_roads'
Processing: Node(108590k 1840.5k/s) Way(0k 0.00k/s) Relation(0 0.0/s)2021-11-16 20:49:31  ERROR: failed to uncompress data: data error


## What did you do to try analyzing the problem?

<!-- Describe what steps you already did to try analyzing the problem before
reporting. -->

I changed parameters in the docker command, verified the md5 of the planet-latest.osm.buf.  Ran the command and got the same parsing error 3 times.



-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/1582
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20211116/47a021af/attachment.htm>