[OSM-dev] Storing way/relation start offset in PBF file

Scott Crosby scrosby at cs.rice.edu
Tue Dec 14 20:26:15 GMT 2010

> There's a way you could split it up a lot faster. There's no need to
> decompress each block. Just copy the blocks that contain entities that
> you're interested in.

Just a data point for doing this:

I implemented a quick Java program that CRC's every block in a PBF
file. It decompresses each block but does not parse them. On my 3 year
old laptop, It can run through a 4 gigabyte PBF file in 2.5 minutes.


More information about the dev mailing list