[OSM-dev] Ideas for speeding up the TIGER import

Tom Hughes tom at compton.nu
Sat Sep 1 19:46:14 BST 2007


In message <46D9A74E.9010900 at arjam.net>
          "Robert (Jamie) Munro" <rjmunro at arjam.net> wrote:

> Jon Burgess wrote:
>
> > Part of the reason why I wrote the original email was also to try to
> > alert everyone to the sheer size of the data we are attempting to pull
> > in. Once complete, the existing OSM data will be just 5% of the combined
> > data set.
> > 
> > We should not under estimate how many things are going to get broken by
> > importing all the tiger data, e.g.
> > 
> > - the current disk space in DB.
> 
> Disks are cheap. I think the foundation could easily raise a few
> thousand pounds and buy a new high-specification DB server. In fact,
> they may have the money already.

We do have some money, and a DB server is among the things I am
speccing at the moment. It's just that I may have underspecced it
a bit for Tiger ;-)

We're going to hit some sort of database/schema wall long before
Tiger is finished anyway - we're pretty close now I suspect. That
isn't something simple hardware upgrades is going to solve either.

Tom

-- 
Tom Hughes (tom at compton.nu)
http://www.compton.nu/




More information about the dev mailing list