[OSM-newbies] Can SQLite3 handle OSM 150G data file?

Jan Klopper janklopper at gmail.com
Mon May 11 15:46:22 BST 2009


Hi,

Maybe this could be done at the servers for osm?
This way updates could be done incrementally making sure the indexing
doesn't take forever.

greets


On Mon, May 11, 2009 at 3:48 PM, Kelly Jones
<kelly.terry.jones at gmail.com> wrote:
> Thanks to everyone who replied.
>
> OK, loading all the nodes for OSM doesn't take much time, but INDEXing
> the fields takes forever (days).
>
> The first time I tried this, I pre-created the indexes before loading
> the data. That's why the load took so long.
>
> This time, I loaded the data first (fairly quick) and then created the
> indexes. It's now been several days and the indexes are still being
> created.
>
> Thoughts?
>
> --
> We're just a Bunch Of Regular Guys, a collective group that's trying
> to understand and assimilate technology. We feel that resistance to
> new ideas and technology is unwise and ultimately futile.
>
> On 4/27/09, Kelly Jones <kelly.terry.jones at gmail.com> wrote:
>> I've seen many posts saying that SQLite2 can't handle OpenStreetMap's
>> large planet.osm data file:
>>
>> http://planet.openstreetmap.org/planet-090421.osm.bz2
>>
>> which is 5.4G bzip2 compressed, about 150G uncompressed.
>>
>> Can SQLite3 handle this? Has anyone tried?
>>
>> I tried to do this myself, but I'm on a slow machine and it's taking
>> too long (several days so far). If someone's done this, can I get a copy?
>
> _______________________________________________
> newbies mailing list
> newbies at openstreetmap.org
> http://lists.openstreetmap.org/listinfo/newbies
>



-- 
Vriendelijke groeten,
Jan Klopper
Innerheight internet diensten
http://www.innerheight.com




More information about the newbies mailing list