[Tile-serving] [openstreetmap/osm2pgsql] osm2pgsql ran out of RAM importing a 84 GB PBF on a system with 64 GB of RAM (Issue #1954)

[Mark Litwintschik]

The following ran on Ubuntu 20 LTS with 64 GB of RAM, PG 15 and PostGIS 3.2.1.

```
$ osm2pgsql --version
```

```
2023-04-19 04:34:59  osm2pgsql version 1.7.2 (1.7.2-141-gae35b32e)
Build: RelWithDebInfo
Compiled using the following library versions:
Libosmium 2.17.3
Proj [disabled]
Lua 5.3.3
```

```bash
$ wget -c https://overturemaps-us-west-2.s3.amazonaws.com/release/2023-04-02-alpha/planet-2023-04-02-alpha.osm.pbf
```

The above is 84 GB.

```bash
$ osm2pgsql -d overture planet-2023-04-02-alpha.osm.pbf
```

```
2023-04-18 17:17:30  osm2pgsql version 1.7.2 (1.7.2-141-gae35b32e)
2023-04-18 17:17:30  Database version: 15.1 (Ubuntu 15.1-1.pgdg20.04+1)
2023-04-18 17:17:30  PostGIS version: 3.3
2023-04-18 17:17:30  Setting up table 'planet_osm_point'
2023-04-18 17:17:30  Setting up table 'planet_osm_line'
2023-04-18 17:17:30  Setting up table 'planet_osm_polygon'
2023-04-18 17:17:30  Setting up table 'planet_osm_roads'
Processing: Node(5036470k 7133.8k/s) Way(0k 0.00k/s) Relation(0 0.0/s)Killed
```

-- 
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/1954
You are receiving this because you are subscribed to this thread.

Message ID: <openstreetmap/osm2pgsql/issues/1954 at github.com>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20230418/bbb2a8b6/attachment.htm>