[OSM-dev] md5sums

Jon Burgess jburgess777 at googlemail.com
Thu Jul 3 19:48:58 BST 2008


On Thu, 2008-07-03 at 11:29 -0700, SteveC wrote:
> On 3 Jul 2008, at 11:00, Jon Burgess wrote:
> 
> > On Thu, 2008-07-03 at 09:59 +0100, Andy Allan wrote:
> >> Hi all,
> >>
> >> Would it be possible to add md5sums alongside the files on
> >> planet.openstreetmap.org? Especially for the planet files where  
> >> having
> >> osm2pgsql bail a few hours into import is a bit annoying :-)
> >
> > Sure, it would be quite easy to add to the script [1] and we could
> > easily generate them for the older files.
> 
> is there a way to do it as part of the stream process so you don't  
> have to read the entire file again?

Something like:

planetdump | gzip -9 | tee ${cur_planet}.gz | sha1sum - > ${cur_planet}.gz.sha1

Then you'll have to replace the '-' filename in the .sha1 file afterwards

It is hardly worth the effort though. The md5/sha1 process is trivial in
comparison to the number of hours it takes to do the bzip2 compression.

	Jon






More information about the dev mailing list