[OSM-dev] [osmosis-dev] Proposal for a multithreaded PBF reader
Jochen Topf
jochen at remote.org
Wed Apr 29 18:00:40 UTC 2015
On Mi, Apr 29, 2015 at 10:55:57 -0600, Martijn van Exel wrote:
> That's useful, but still does not allow you to optimize threading
> because you don't know in advance how many blocks there are, or is
> there a way to know / estimate this based on the '~8k' block size
> (from the wiki)?
Why would you need the number of blocks? Just use a work queue and max out the
number of CPUs you have with threads. Usually the number of blocks will be
far larger than the number of CPUs. (And if not, the file is small and it
doesn't matter really.)
Jochen
--
Jochen Topf jochen at remote.org http://www.jochentopf.com/ +49-351-31778688
More information about the dev
mailing list