[Tile-serving] [openstreetmap/osm2pgsql] osm2pgsql "failed to uncompress data: data error" when importing planet-latest.osm.pbf (Issue #1582)

[Jochen Topf]

Not sure what's the problem here. The error `failed to uncompress data: data error` points to invalid input data, but you said you veryfied the md5sum. So maybe it is simply a memory problem. 16GB isn't enough for a planet import in a reasonable amount of time, see https://osm2pgsql.org/doc/manual.html#main-memory for some ideas. Also it doesn't make any sense to run with these many threads if you only have 4 CPUs. And you don't need the `-C` param if you use flat nodes, not sure whether you actually set that or not, with all the docker mumbo jumbo I am not sure which command you actually ran.

Try an import with a smaller extract first and once you are successful, scale up to larger and larger imports. This will give you an idea how on how much memory is needed and how long things will take if scaled up.

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/1582#issuecomment-971406363
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20211117/40b023d9/attachment.htm>