[OSM-talk] Downloading compressed data from API

Jochen Topf jochen at remote.org
Sun Aug 10 20:44:45 BST 2008


On Sun, Aug 10, 2008 at 09:35:35PM +0200, Ben Laenen wrote:
> On Sunday 10 August 2008, Tom Hughes wrote:
> > Ben Laenen wrote:
> > > I was wondering if it's possible to download data from the API in a
> > > (bz2/g)zipped format? This would be much more kind to bandwidth
> > > since a 10MB file for the plain data can be easily compressed to
> > > under 1MB.
> >
> > It is compressed if your user agent indicates that it supports
> > compressed transfers.
> 
> Hmm, I was hoping more for some extra tag attached to the url...
> 
> So, how should I do that when I use wget to download the data? I have 
> shell scripts to download data automatically and wget is by far the 
> easiest way to do that, but can't find any documentation for that.

You could do something with the --header=header-line option to wget or
you can switch to curl which has a --compressed option.

Jochen
-- 
Jochen Topf  jochen at remote.org  http://www.remote.org/jochen/  +49-721-388298





More information about the talk mailing list