[OSM-dev] Slow Osmosis

[Brett Henderson]

If somebody can prove with real numbers on very large files that LOAD 
DATA INFILE is much faster than the current osmosis approach of doing 
normal inserts (ie. not just a few per cent) I'll add it to osmosis.  I 
just haven't done so because my efforts have been focused elsewhere.

Andreas Kalsch wrote:
> I decompress the data before putting them into Osmosis, but it's still slow.
> So back to my question -- ;)
> (The best would be raw dump files for MySQL's "LOAD DATA INFILE" - I can 
> imagine that it would be pretty quick)
>
> Stefan de Konink schrieb:
>   
>> Frederik Ramm wrote:
>>     
>>> The Java implementations of gzip/bzip are notoriuosly slow. If you 
>>> are working with compressed data, you might see an improvement if you 
>>> first uncompress the file and then use osmosis to process it in raw 
>>> form; later use an external utility to compress the output if 
>>> applicable.
>>>       
>> But if he first uncompresses the data basically osmosis looses its 
>> main argument to be superior to any other approach.
>>
>> (Yes I think this point should be made)
>>
>>
>> Stefan
>>
>>
>>     
>
>
> _______________________________________________
> dev mailing list
> dev at openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>