[OSM-dev] Ideas for speeding up the TIGER import
tom at compton.nu
Sat Sep 1 19:46:14 BST 2007
In message <46D9A74E.9010900 at arjam.net>
"Robert (Jamie) Munro" <rjmunro at arjam.net> wrote:
> Jon Burgess wrote:
> > Part of the reason why I wrote the original email was also to try to
> > alert everyone to the sheer size of the data we are attempting to pull
> > in. Once complete, the existing OSM data will be just 5% of the combined
> > data set.
> > We should not under estimate how many things are going to get broken by
> > importing all the tiger data, e.g.
> > - the current disk space in DB.
> Disks are cheap. I think the foundation could easily raise a few
> thousand pounds and buy a new high-specification DB server. In fact,
> they may have the money already.
We do have some money, and a DB server is among the things I am
speccing at the moment. It's just that I may have underspecced it
a bit for Tiger ;-)
We're going to hit some sort of database/schema wall long before
Tiger is finished anyway - we're pretty close now I suspect. That
isn't something simple hardware upgrades is going to solve either.
Tom Hughes (tom at compton.nu)
More information about the dev