[OSM-dev] Can SQLite3 handle OSM 150G data file?

Erik Johansson emj at kth.se
Sat May 16 11:08:26 BST 2009


On Fri, May 15, 2009 at 10:58 AM, Tomas Kolda <kolda at web2net.cz> wrote:
> Did you try my version of import? I have no responses, so maybe not :).
> I did not tried complete planet, but indexes was created quite fast.
> 30seconds on 150MB osm file.
>
> I think that you should make a chart (xml size->time to create index)
> and than you can see complexity of creating indexes in sqlite based on
> OSM size. I think that it will be O(n log(n)), but maybe not.

Handling disk isn't the strong point of SQLite, creating your SQLite
DBs on machines with lots of memory will make things useable. You can
always move them to low memory machines later.

Storing the DB on a ram disk while creating will speed things up considerably.




More information about the dev mailing list