[OSM-dev] Memory error while converting osm to gml

Stefan de Konink stefan at konink.de
Sat Apr 4 19:32:25 BST 2009


Matt Amos wrote:
> 2009/4/4 Martijn van Oosterhout <kleptog at gmail.com>:
>> Just reading this again made me realise that we could probably make
>> osm2pgsql faster for the common case just by forking and using
>> gzip/bzip2 to do the decompression in a separate process (i.e. another
>> CPU)... Not entirely sure how much you'd save though (ISTR someone
>> saying it was the polygon construction that took a lot of time), but
>> it'd surely help somewhat.
> 
> i found that using unix pipes (i.e: bzcat | osm2pgsql -) for this
> didn't take any less time, probably because bzcat/osm2pgsql are both
> using synchronous reads and writes. maybe if decompression was on a
> different thread using a pair of synchronised buffers?

You could try named pipes.


Stefan




More information about the dev mailing list