[OSM-talk] osm2pgsql & planet: frustrations, cutoffs, and idempotence
tom at compton.nu
Mon Oct 27 08:22:32 GMT 2008
Shaun McDonald wrote:
> On 27 Oct 2008, at 00:50, Michal Migurski wrote:
>>> Planet dumps are not snapshots - they do not represent a consistent
>>> view at any particular point in time because they take a number of
>>> hours to generate, during which time new changes are constantly
>>> being made to the contents of the database.
>> Shouldn't it be possible to ignore any changes that happen after the
>> cutoff, though?
> At the moment we don't look at the time stamps when dumping the planet
It's not as simple as that - you also have to switch to reading the
history tables rather than the current tables or you won't be able to
see what the state of the object used to be if it has changed since the
Which means you're reading much more data, and either having to track
the state of each object (in order to find the most recent valid change)
or you have to index scan so that you're seeing things in timestamp order.
Tom Hughes (tom at compton.nu)
More information about the talk