[OSM-dev] Write PBF

Anthony osm at inbox.org
Wed Jun 1 14:53:54 BST 2011


On Wed, Jun 1, 2011 at 9:49 AM, Anthony <osm at inbox.org> wrote:
> On Wed, Jun 1, 2011 at 8:23 AM, "Michael Prieß" <michael.priess at gmx.de> wrote:
>> Hello,
>>
>> I found in the OSM Wiki the following article.
>>
>> http://wiki.openstreetmap.org/wiki/PBF_Format
>>
>> "It is also about 5x faster to write than a gzipped planet and 6x faster to read than a gzipped planet."
>>
>> Can anyone say how long do I need to write from database to pbf a country like Germany? Minutes, Hours, Weeks?
>
> First it depends on the schema of your database.  If node table is
> already clustered by node id, and the way table is clustered by way
> id, it's going to be at least an order of magnitude faster.  Once
> you've got the tables clustered by id, it's basically a matter of how
> fast can you write to disk.  You're most likely going to be i/o bound.

By the way, why do you want to write from database to pbf?  In the
vast majority of cases you're better off using your database's dump
program.  (e.g. pg_dump -Fc ... | xz -1 >file.dump.xz, or use lzop if
xz -1 is CPU bound)



More information about the dev mailing list