[Geocoding] Nominatim Install Problems

[Gergely Hanti]

Hello,

I am experiencing the same problem with Debian, PostgreSQL 8.3.12, PostGIS
1.3.3 and 1.5.2, with a two months old osm2pgqsl version.
I have been testing it on two dedicated hardware configurations. The
stronger one is a System x3650 M2 with 24GB Ram.

I am trying to load the Europe extract. The oom-killer kills the postgre
process at 70% during the loaddata phase.
- With the weaker hardware config (with 4Gb Ram) it happened much earlier.
- Updating PostGIS didn't help. The process stopped nearly at the same
percent.
- I have tried setting Debian's overcommit mode to strict (as was suggested
 here:
http://www.postgresql.org/docs/8.2/static/kernel-resources.html#AEN19382)
but this only resulted that the postgresql stopped the process and not the
oom-killer.
- I could process smaller extracts without any problems.

At first I thought that this was a pure pg issue. That is why I had asked
for help at the pg forum (
http://www.pg-forum.de/konfiguration/4971-out-memory-linux.html), but then I
have found this thread. I hope somebody can help me here to solve this
issue.

Here are some further informations:
For the stronger hardware config with 24Gb Ram:
I've set Debian's SHMMAX to 8GB = 8*1024*1024*1024 = 8589934592, and SHMALL
to SHMMAX/4096 = 2097152

107,108c107
< shared_buffers = 6GB
---
> shared_buffers = 32MB
115,116c114,115
< work_mem = 256MB
< maintenance_work_mem = 256MB
---
> #work_mem = 1MB
> #maintenance_work_mem = 16MB
121c120
< max_fsm_pages = 1592000
---
> max_fsm_pages = 204800
153c152
< fsync = off
---
> #fsync = on
163c162
< wal_buffers = 24MB
---
> #wal_buffers = 64kB
172c171
< checkpoint_segments = 20
---
> #checkpoint_segments = 3
174c173
< checkpoint_completion_target = 0.9
---
> #checkpoint_completion_target = 0.5
205c204
< random_page_cost = 1.5
---
> #random_page_cost = 4.0
209c208
< effective_cache_size = 20GB
---
> #effective_cache_size = 128MB
383c381
< autovacuum = off
---
> #autovacuum = on

Regards,
Gergő
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/geocoding/attachments/20110224/6c3386e7/attachment.html>