[OSM-dev] planet.osm.org is verry slow

[Yuri Astrakhan]

OpenMapTiles has a tool to download the planet from all mirrors in
parallel.  Usually takes a few minutes, and it automatically verifies md5
checksum.  The tool will not use the primary planet source by default.
Lastly, the tool can also download validated extracts
from geofabrik, bbbike, and osmfr.  Internally the tool uses aria2c.

Easiest is to use it with the docker -- share current dir with docker and
save the file there. Anything after the "--" will be passed to aria2c. This
is a Linux/Mac command, but should be runnable from Windows too with minor
path fixes.

  docker run --rm -it -v $PWD:/planet openmaptiles/openmaptiles-tools
download-osm planet -- -d /planet

To run it without the actual download (test run), use --dry-run:

  docker run --rm -it openmaptiles/openmaptiles-tools download-osm planet
--dry-run

Use --help for all arguments.  See source and documentation here:
https://github.com/openmaptiles/openmaptiles-tools#multi-streamed-osm-data-downloader


On Sat, Jan 25, 2020 at 5:33 AM Wolfram Schneider <wosch at freebsd.org> wrote:

> I wanted to download the latest planet from planet.osm.org and the
> download rate is  less than 450KByte/s. In the past I got
> 30-60Mbyte/s. It takes now more than 36 hours to download the planet
> (was 15min). All mirrors are outdated, you have to wait until Sat
> morning to see a new planet.osm.pbf file.
>
> I tried to download the planet from different locations, IP addresses
> and clients - it is always slow per connection. It seems that the
> slowdown is on purpose by a config change, not an overloaded machine.
>
> Two weeks ago everything was fine. Does anybody has an idea whats happens
> here?
>
> Thanks, Wolfram
>
> --
> Planet.osm extracts: https://extract.bbbike.org
> BBBike Map Compare: https://mc.bbbike.org
>
> _______________________________________________
> dev mailing list
> dev at openstreetmap.org
> https://lists.openstreetmap.org/listinfo/dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20200125/5bd57c30/attachment.htm>