[Tile-serving] [openstreetmap/osm2pgsql] osm2pgsql crashes (silently, but creates windows log event) when importing bz2 data (#903)

[mmd]

I tried the artifact generated by Appveyor (https://ci.appveyor.com/project/openstreetmap/osm2pgsql/builds/29393880/job/iug627ib07u3ejxw), and ran an osm.bz2 using Wine (Windows emulator) on Linux. Processing gets stuck very early during XML parsing with the libbz2.dll included in the artifact.

I think it might be worth trying a different (newer) libbz2.dll on Windows as well.

```
wine ./osm2pgsql.exe  ... saarland.osm.bz2
osm2pgsql version 1.2.0 (64 bit id space)

Allocating memory for sparse node cache
Node-cache: cache=800MB, maxblocks=12800*65536, allocation method=1
Using built-in tag processing pipeline
Using projection SRS 3857 (Spherical Mercator)
Setting up table: planet_osm_point
Setting up table: planet_osm_line
Setting up table: planet_osm_polygon
Setting up table: planet_osm_roads

Reading in file: saarland.osm.bz2
Using XML parser.
0047:err:ntdll:RtlpWaitForCriticalSection section 0x7f71b8015d40 "?" wait timed out in thread 0047, blocked by 0000, retrying (60 sec)
0047:err:ntdll:RtlpWaitForCriticalSection section 0x7f71b8015d40 "?" wait timed out in thread 0047, blocked by 0000, retrying (60 sec)
```

In second step I replaced liibbz2.dll by the version 1.0.8.0 on https://github.com/philr/bzip2-windows/releases - this time processing was successful:

```
Reading in file: /saarland.osm.bz2
Using XML parser.
Processing: Node(1214k 404.9k/s) Way(157k 52.33k/s) Relation(0 0.00/s)  parse time: 6s
Node stats: total(1214809), max(1992650611) in 3s
Way stats: total(188736), max(188645882) in 3s
Relation stats: total(1924), max(2545512) in 0s
Sorting data and creating indexes for planet_osm_point
node cache: stored: 1214809(100.00%), storage efficiency: 50.00% (dense blocks: 0, sparse nodes: 1214809), hit rate: 100.00%
Sorting data and creating indexes for planet_osm_line
Sorting data and creating indexes for planet_osm_polygon
Sorting data and creating indexes for planet_osm_roads
Copying planet_osm_roads to cluster by geometry finished
Creating geometry index on planet_osm_roads
Creating indexes on planet_osm_roads finishe

```

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/903#issuecomment-562965040
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20191208/85b418ec/attachment-0001.html>