[OSM-dev] planet.openstreetmap.org/replication policy
Tom Hughes
tom at compton.nu
Mon Nov 28 13:11:06 UTC 2016
On 28/11/16 12:24, Oliver Tonnhofer wrote:
> I'm the author of Imposm 3 (https://github.com/omniscale/imposm3/) and I'm working on a new command that will automatically download and import diff files from planet.openstreetmap.org as they appear.
>
> Normally, it should only make two requests per minute when using minutely replication. One for the state and one for the osc.gz file. But after the initial import it will download the diff files as fast as Imposm can import them till it catches up with the live updates.
>
> A fast server should be able to process 100 diffs per second and more, especially when only a smaller extract is imported. My question: Is this OK, or should I add a throttle for this?
As Yves said the best plan would be to use daily diffs until you get to
the current day, then hourlies and only switch to minutelies when you
get to the last hour.
Tom
--
Tom Hughes (tom at compton.nu)
http://compton.nu/
More information about the dev
mailing list