[OSM-dev] Import planet.osm to rails

[Brett Henderson]

Dave Stubbs wrote:
> Ah, yes, that makes sense. Thanks.
>
> I'm not in any hurry. I can continue using the hacked up "My 1st Rails
> Hack" map created using JOSM using nodes segments and ways. The "M" is
> a motorway and the "1" is oneway residential if anyone is
> interested... I've even underlined the lot with a river. :-)
>   
Well, that didn't take as long as I thought.

This should do the trick ...
http://www.bretth.com/osmosis/osmosis-latest.zip

It creates a new user with email address "osmosis at bretth.com" (hardcoded 
for now) which will be used for all edits.

Overview here:
http://wiki.openstreetmap.org/index.php/Osmosis

Full command line details here (must migrate this to OSM wiki one of 
these days):
http://www.bretth.com/wiki/Wiki.jsp?page=OpenStreetMap

If you want to import the whole planet though, patience will be 
required.  You're looking at around 4 hours for the import, 3 hours of 
which seem to be populating the "current" tables.  If anybody has any 
relatively straightforward suggestions on increasing the speed of 
copying data into InnoDB tables I'm all ears.  No simple way of 
disabling indexes (that I can find), and I have to chunk into 
"reasonable" sized transactions or nasty runaway rollbacks will occur if 
the process is interrupted.

If you want to limit the size of the import, try using the 
--bounding-box task to extract the area you want (I often use Australia 
for testing, approx 120MB).  If dates aren't important, you can further 
speed things up by applying the enableDateParsing=no option to the 
--read-xml task.

I'm currently running an import on the August 25 planet to test it 
properly but it will take a while to finish.