[OSM-dev] md5sums
Jon Burgess
jburgess777 at googlemail.com
Thu Jul 3 19:48:58 BST 2008
On Thu, 2008-07-03 at 11:29 -0700, SteveC wrote:
> On 3 Jul 2008, at 11:00, Jon Burgess wrote:
>
> > On Thu, 2008-07-03 at 09:59 +0100, Andy Allan wrote:
> >> Hi all,
> >>
> >> Would it be possible to add md5sums alongside the files on
> >> planet.openstreetmap.org? Especially for the planet files where
> >> having
> >> osm2pgsql bail a few hours into import is a bit annoying :-)
> >
> > Sure, it would be quite easy to add to the script [1] and we could
> > easily generate them for the older files.
>
> is there a way to do it as part of the stream process so you don't
> have to read the entire file again?
Something like:
planetdump | gzip -9 | tee ${cur_planet}.gz | sha1sum - > ${cur_planet}.gz.sha1
Then you'll have to replace the '-' filename in the .sha1 file afterwards
It is hardly worth the effort though. The md5/sha1 process is trivial in
comparison to the number of hours it takes to do the bzip2 compression.
Jon
More information about the dev
mailing list