[OSM-dev] How do I build the latest db schema?

[Brett Henderson]

I've fixed the bug and uploaded a new version.
http://www.bretth.com/osmosis/osmosis-0.1.9.zip
http://www.bretth.com/osmosis/osmosis-latest.zip

It has completed a full import with the following stats:
12486828 nodes
12475582 segments
823816 ways
2475452 way tags
11799114 way segments

It took a total of 3 hours 45 minutes.  Indexing appears to be a huge 
overhead, I suspect that finding a way of disabling indexes would result 
in large savings, it's heavily io bound during node creation 
particularly at the end.  This is all on an Athlon 64 3800+ with 
everything running off a Seagate 160GB SATA drive.

The memory usage appeared stable throughout but I wasn't monitoring it 
during way creation where it blew up last time.

I haven't yet added code to copy data from history tables to current tables.

Brett Henderson wrote:
> After my previous email, I kicked off an import to my local database.  
> Before I added date handling it used to complete in 70'ish minutes.  
> Since then the dataset appears to have grown considerably so I had 
> expected it to take somewhat longer.
>
> It crashed after 4 hours with an out of memory error.  This is 
> surprising because it was supposed to be processing in a streamy 
> fashion.  I made some changes to the database layer so I've probably 
> forgotten to release something.  I changed my handling of prepared 
> statements and suspect that may be the problem.  Coincidentally it 
> failed after it had completed all nodes, all segments and had only 
> processed a small number of way records (40000), this may be related.
>
> Looks like I have some work to do before a load will work properly