[OSM-dev] osm2pgsql planet import time issues?

Dave Stubbs osm.list at randomjunk.co.uk
Tue Jan 20 22:54:57 GMT 2009


2009/1/20 Ivo Brodien <philotas at cs.tu-berlin.de>:
> Hello list,
>
> I am trying to import the planet file into PostgreSQL/PostGIS.
>
> I was already in contact with Jon Burgess, the author of the tool
> because I had a "Segmentation fault" after some hours of processing.
> He suggested to try the "--slim" option., although it makes the
> process very slow. I tried it (without changing the default 800MB
> cache setting).


Yes, you can't now run it on a 32 bit system in non-slim mode without
getting a segfault as you run out of address space.
In general give it as much cache as you can. I do it with -C 2000 and
it works (slowly, about 8-9 hours for the whole planet). But I have
8GB of RAM to play with. With only 2GB you're going to have to go to
swap to complete the process anyway, so I'd just leave it on the
default.

You can check http://www.openstreetmap.org/stats/data_stats.html to
see the current object counts. It's about 24m ways.

If you don't need the whole planet then use an extract -- it goes a
lot quicker. Otherwise invest in some more RAM -- it helps! :-)

Dave




More information about the dev mailing list