[OSM-dev] release of full-history extracts

[Peter Körner]

Hi all, 

User:Marqqs notified me that some of my .osh.pbf extracts did not
contain visible="false" information and he was right.

I generated the "full-planet-110418-0000.osm.pbf" with the file
extension ".osm.pbf" which advised osmium to drop the visible
information. When I later created the extracts, I used the ".osh.pbf"
extension, advising osmium to add history information. Because the
source did not contain such, it was replaced with the default value of
"true".

I'm currently re-generation those files and try to get them uploaded
tomorrow.

The following files are affected:
europe/france.osh.pbf
europe/netherlands.osh.pbf
europe/germany/rheinland-pfalz/gau-odernheim.osh.pbf
europe/france/paris.osh.pbf
europe/france/nancy.osh.pbf
europe/netherlands/amsterdam.osh.pbf


The following files are fine, they have been converted from
their .osh.bz2 pendents.
europe/germany.osh.pbf
europe/germany/rheinland-pfalz.pbf
europe/germany/bayern.osh.pbf
europe/germany/berlin.osh.pbf
europe/germany/rheinland-pfalz/gau-odernheim.osh.pbf
europe/germany/rheinland-pfalz/mainz.osh.pbf
europe/germany/rheinland-pfalz/woerrstadt.osh.pbf

Peter

Am Montag, den 30.05.2011, 15:29 +0200 schrieb Peter Körner:
> Dear OSM-Develpoers,
> 
> New extracts are now online, including the requested Amsterdam extract:
>  
> <ftp://ftp5.gwdg.de/pub/misc/openstreetmap/osm-full-history-extracts/110418/hardcut-bbox-pbf/>
> 
> They are in a slightly modified PBF-Format that supports the visible 
> Flag [1].
> 
> They can be read using this modified version of osmium [2] and its tools 
> (ie. osmium_convert [3], which allows you to convert the file back to xml).
> 
> If you need help reading those files, don't hesitate to ask me.
> 
> It has been created using my history-splitter [4] which is build using 
> this very cool library.
> 
> To generate those dumps I first used osmium_convert to create a 
> pbf-bersion of the full-planet-110418-0000.osm.bz2 (I'll publish this 
> file soon). This conversion took 8 hours.
> 
>  From this pbf file the actual split took just 1 hour (compared to the 
> 21 hours when I was writing to .osm.bz2 files!!) - what an incredible 
> speedup!
> 
> Peter
> 
> 
> 
> [1] 
> <https://github.com/MaZderMind/OSM-binary/commit/1ddaca6a03afde8d16e4bf7ab3cd065f09c8d9b1>
> [2] <https://github.com/MaZderMind/osmium>
> [3] 
> <https://github.com/MaZderMind/osmium/blob/master/examples/osmium_convert.cpp>
> [4] <https://github.com/MaZderMind/osm-history-splitter>
> 
> 
> Am 17.05.2011 08:30, schrieb Martijn van Exel:
> > Hi Peter,
> >
> > On Thu, May 12, 2011 at 10:46 AM, Peter Körner<osm-lists at mazdermind.de>  wrote:
> >> Hi
> >>
> >> I'm very proud to announce the release of the first history extracts. They
> >> have been created from the latest full-experimental-dump [1] using my
> >> history splitter [2], based on a slightly modified version of Jochen Topfs
> >> really great osmium framework [3]. They contain multiple versions of an
> >> object. If you just want the map-data as it is currently, use the
> >> Geofabrik-Extracts [4].
> >>
> >> The extracts can be downloaded from gwdg:
> >>
> >> <ftp://ftp5.gwdg.de/pub/misc/openstreetmap/osm-full-history-extracts/110418/hardcut-bbox-xml/>
> >>
> >>
> >
> > Thanks for this! I haven't had time to look into them but I am eager
> > to start working with them. These will be helpful for the Essen hack
> > weekend as well!
> >
> > I haven't really looked into it, but would it be straightforward to
> > make an Amsterdam extract using your script? When doing analyses it
> > helps to work with an area you know - at least being able to compare
> > to an area you know.
> >
> > Thanks again
> > Martijn
> >
> 
> 
> _______________________________________________
> dev mailing list
> dev at openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev