[OSM-dev] Importing planet file with osmosis into PostgreSQL

[Shaun McDonald]

There are some additional hints on the following wiki page:
http://wiki.openstreetmap.org/wiki/Mapnik#Loading_Data

I'm sure other people on the list will be able to add more than me on tuning postgres. You should expect it to take a day or two to load if the disks are slow. There are a few discussions in the archives that may be of some help to you.

Shaun

On 13 Dec 2009, at 12:21, Frank Bielig wrote:

> 
> Many thanks for fast and valuable responses. One more open question I have.
> 
> Currently I need about four days for importing the whole planet file. Is that a normal computing time? The bottleneck seems to be the database (PostgreSQL). Are there any hints for the database configuration? For conversion I use  a quadcore machine with 8GB RAM. Data files are located on an own hard drive.
> 
> Frank
> 
> 
>> On 13 Dec 2009, at 10:47, Lennard wrote:
>> 
>>  
>>> Frederik Ramm wrote:
>>> 
>>>    
>>>> The planet files do not have referential integrity. Because the ways are dumped long after the nodes, if someone creates a new way plus new nodes some time during the planet dump creation, the new way will be in the dump but the new nodes will not.
>>>>      
>>> I thought that was fixed, and the dump now runs in a transaction?
>>> 
>>>    
>> 
>> It is using a transaction, however a locking transaction (which would be needed for this) reduces performance too much thus isn't done.
>> 
>>  
>>> It would thus more likely point to data that is in fact incomplete in the OSM db itself?
>>>    
>> 
>> Nope.
>> 
>> More information is available on http://wiki.openstreetmap.org/wiki/Planet.osm/FAQ
>> and
>> http://wiki.openstreetmap.org/wiki/Planet.osm
>> 
>> Shaun
>> 
>> 
>> _______________________________________________
>> dev mailing list
>> dev at openstreetmap.org
>> http://lists.openstreetmap.org/listinfo/dev
>>  
> 
> 
> -- 
> Frank Bielig               Tel:   +49 33398 687848
> OneStepAhead AG            Fax:   +49 33398 687849
> Research & Development     Mobil: +49 177 3339868
> Leuschnerstr. 45           eMail: Frank.Bielig at OneStepAhead.de
> D-70176 Stuttgart          Web:   http://www.OneStepAhead.de
> 
> Firma:                     OneStepAhead AG
> Firmensitz/Amtsgericht:    Stuttgart, HRB 22686
> Vorstand/Vorsitzender:     Nihat Kücük
> Aufsichtsratvorsitzender:  Prof. Dr. Reinhold von Schwerin
>