[OSM-dev] osm2pgsql slow on update import

[Andres Kaaber]

I'v been fighting with the same problem for year now. I have a quite
powerfull server AMD 8 cores 16G ram and database on 2x10k sas disks
on raid1. Planet import takes 20hours and I still cant get the
database up to date. At the beginning it takes a lot less time to
apply diff but as the time passes it takes more and more and at some
point it takes a lot more time. I'm not sure what version is
osm2pgsql, I'll check, but my guess is it from after (31st Jan)..

2011/4/5 Phil! Gold <phil_g at pobox.com>:
> * Frederik Ramm <frederik at remote.org> [2011-04-05 11:58 +0200]:
>> Make sure you've got at least osm2pgsql r25198 (31st Jan) as this will
>> turn the "fastupdate" feature off. The impact of this is most
>> pronounced on Postgres 8.4 but seems to be present on 9.0 also.
>
> Seconded.  I have my database on a RAID1 pair of 5.4K RPM drives (which
> gives me a speed up in reads and data redundancy, but seems about the same
> as a single disk in terms of writes) and am using PostgreSQL 9.0.  Before
> the fastupdate patch, one minute of diffs took between 2 and 5 minutes to
> apply.  Now my system can keep up with the diffs easily despite constant
> rendering on both of the CPU's cores.
>
> --
> ...computer contrarian of the first order... / http://aperiodic.net/phil/
> PGP: 026A27F2  print: D200 5BDB FC4B B24A 9248  9F7A 4322 2D22 026A 27F2
> --- --
> Einstein argued that there must be simplified explanations of nature,
> because God is not capricious or arbitrary.  No such faith comforts the
> software engineer.
>                       -- Fred Brooks, Jr.
> ---- --- --
>
> _______________________________________________
> dev mailing list
> dev at openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>



-- 
A. Kaaber