[OSM-dev] planet.openstreetmap.org/replication policy

Tom Hughes tom at compton.nu
Mon Nov 28 13:11:06 UTC 2016


On 28/11/16 12:24, Oliver Tonnhofer wrote:

> I'm the author of Imposm 3 (https://github.com/omniscale/imposm3/) and I'm working on a new command that will automatically download and import diff files from planet.openstreetmap.org as they appear.
>
> Normally, it should only make two requests per minute when using minutely replication. One for the state and one for the osc.gz file. But after the initial import it will download the diff files as fast as Imposm can import them till it catches up with the live updates.
>
> A fast server should be able to process 100 diffs per second and more, especially when only a smaller extract is imported. My question: Is this OK, or should I add a throttle for this?

As Yves said the best plan would be to use daily diffs until you get to 
the current day, then hourlies and only switch to minutelies when you 
get to the last hour.

Tom

-- 
Tom Hughes (tom at compton.nu)
http://compton.nu/



More information about the dev mailing list