[OSM-dev] Faster loading with scabies

Stefan de Konink stefan at konink.de
Wed Oct 15 21:22:28 BST 2008


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Joachim Zobel schreef:
> Hi.
> 
> I have written a utility named scabies to load data from osm files into
> a mysql database. See
> 
> http://www.heute-morgen.de/scabies/
> 
> Usage is rather straightforward, but you need lots of disk space.
> scabies_parse.pl parses the osm file and creates files that are then
> loaded by scabies_load.sql with LOAD DATA INFILE. The current version
> only loads the current_* tables, but its easy to extend. It is early
> beta.
> 
> The motivation for this was that osmosis is too slow with the InnoDb
> tables. Checking what osmosis does I found no way to incrementally
> improve it. Loading data can probably not be done much better as long as
> INSERTs are used. 


http://repo.or.cz/w/handlerosm.git?a=blob;f=osmparser.c;h=5357c2b394a75ab7390be0ce1d231123a6a3e5b7;hb=HEAD


If someone things it needs to be even faster.


Stefan
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEAREKAAYFAkj2UQQACgkQYH1+F2Rqwn0pqQCfcH2cswRHlCnbSvCA6Bc59qpF
HXgAn3oE2CxH6eU3dciEP5N/JReC94qs
=dKm4
-----END PGP SIGNATURE-----




More information about the dev mailing list