[OSM-dev] Merging pbf files problem?

[Jon Burgess]

On Mon, 2010-12-20 at 17:07 -0500, Will Wilson wrote:
> Good call. Grepping now. Might take a while. :)
> 
> 
> So two other things:
> 
> 
> 1) Trying to use osm2pgsql to import the merged .pbf file directly
> died with a generic error immediately (as opposed to importing the
> merged XML, which dies 10-15 minutes in). Maybe an error in Osmosis'
> pbf handling?

Is the error message the same?

I'm surprised you did not see any reference to the duplicate key
violation. Did you take a look at the server logs?

The timing is hard to gauge because the PBF parsing is so much faster
than bz2 compressed XML. 

> 
> 2) What's the expected behavior for Osmosis when merging contiguous
> but non-overlapping extracts? Would I have gotten the same problem if
> I'd started with .osm.bz2 ?

I'm unsure. There have been other XML file with different versions of
some elements which trigger a similar problem but there are some
workarounds for this. 

Since the USA is such a large proportion of the whole planet file
(probably over 50%) I believe most people import the whole planet file
instead of trying to extract the US data.

    Jon