[Tile-serving] [openstreetmap/osm2pgsql] osm2pgsql fails on 100MB+ .pbf files when using Aurora Postgres Serverless DB (#1056)

[Chris Bailey]

I have tried this further. In the comments of the other issue (for `imposm`) that I referenced in my original post, someone commented that they had to set the autoscaling to basically not (i.e. set the min and max ACU's to be the same). I just tried this, and after 24+ hours of `osm2pgsql` running to import the north-america-latest file, it failed, again with the following:

```
Reading in file: north-america-latest.osm.pbf
Using PBF parser.
Processing: Node(1157250k 142.5k/s) Way(64162k 0.82k/s) Relation(0 0.00/s)Prepared statement failed with: SSL connection has been closed unexpectedly
 (7)
Query: get_node_list
with arguments:
  0: {4833315345,4833315346,4833315347,4833315348,4833315345}
, result COPY END for planet_osm_polygon failed: SSL connection has been closed unexpectedly
```

So, at this point I'll be using the workaround to use a regular Aurora Postgres instance, take a snapshot, and then restore that to a serverless instance.

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/1056#issuecomment-573226521
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20200110/55af1679/attachment.htm>