[OSM-talk] planet uploads?

[graham]

Jon Burgess wrote:
> On Sat, 2007-09-22 at 13:25 +0100, graham wrote:
>> Are people managing to upload the current planet files at all? I'm just 
>> trying for the first time, using planetosm-to-db.pl to upload to 
>> postgresql on debian lenny. After fixing a minor problem with notes of 
>> more than 255 characters it ran for around 24 hours and ended about 1/3 
>> of the way through the file with the error:
>>
>> Bit::Vector::Bit_On(): index out of range at ./planetosm-to-db.pl line 
>> 271, <XML> line 123584474
>> Should I be using mysql instead of postgres? the ruby uploader? (I 
>> really wanted postgres, as I wanted to try out postgis stuff)
> 
> By postgis, do you mean rails_port_postgis_branch which has records for
> all nodes, segments and ways or do you just want database tables with
> ways described as LINESTRING() etc?

Hmm... dunno. I don't know postgis and wanted to learn something about 
how to use it (I want to do basic distance calculations to start). 
Adding rails to the mix sounds like a whole other layer of complexity I 
could do without, at least till I understand the more basic stuff.

> 
> If you want the latter then you should have more luck with osm2pgsql.
> This is run on the planet dump every week to import the data for the
> Mapnik rendering and so is known to work reliably.
> 

Mainly I want nodes, ways, and tags (all tags), not for rendering but 
for experimenting with answering queries. osm2pgsql looks like it might 
do just what I want - I'll give that a go.

> Another tip is to try running your initial imports on a small set of
> data until you are confident that your setup is correct (e.g. an osm
> file saved by JOSM, a UK-only dump, or one of the older & smaller planet
> files).

That sounds so sensible. It is definitely where I should have started.. :-)

Thanks
Graham

> 
>> Thanks for any advice
>>
>> Graham
>>
>> _______________________________________________
>> talk mailing list
>> talk at openstreetmap.org
>> http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
>