[OSM-talk] osm2pgsql & planet: frustrations, cutoffs, and idempotence

Michal Migurski mike at stamen.com
Mon Oct 27 23:47:01 GMT 2008


> On Mon, Oct 27, 2008 at 9:39 PM, Michal Migurski <mike at stamen.com>  
> wrote:
>> I'm liking Jochen Topf's suggestion here:
>>
>>       "If the planet dump plus the diff from the same day is what  
>> everybody
>> wants anyway, why not do this on the server side and hold the planet
>> back after the first diff is available, run this over the planet and
>> then publish that as the planet?"
>
> 1. Because there are plenty of uses for the planet dump that don't
> need consistant snapshots.

Those uses would not be impacted by consistent snapshots.


> 2. Because such consistant snapshots have been available elsewhere for
> quite a while now and people who need them can get them. There's no
> particular reason why it has to be on the same site as the normal
> planet dumps.

Yet there is no link to these places from planet.openstreetmap.org  
that indicates that the files available there differ in some important  
or useful way. The telascience.org source you suggested is described  
as "extracts of NL, Scandinavia and Taiwan" at http://wiki.openstreetmap.org/index.php/Planet.osm 
, rather than a complete dump of Planet with different datetime  
boundaries.

I'm happy to keep bellying up to the trial & error bar here, but as I  
mention in a previous mail, the volume of data involved means that  
individual attempts at the data (successful or not) have multiple-day  
costs associated with them.


> Umm, yeah. I was ofcourse assuming you were running the latest
> version, otherwise anything is possible, The creates-as-modifies fix
> was done two months ago.


I'll recompile and replace the two-month-old version of osm2pgsql I've  
been using.

-mike.

----------------------------------------------------------------
michal migurski- mike at stamen.com
                  415.558.1610







More information about the talk mailing list