[OSM-dev] Mass imports (TIGER and AND)

Dave Hansen dave at sr71.net
Tue Aug 28 19:23:25 BST 2007


On Tue, 2007-08-28 at 19:06 +0100, Ray Booysen wrote:
> Will not moving some of the work out to seperate clients not solve this 
> problem?  With testing you're doing requests from one machine whereas 
> the server should be able to handle multiple requests from multiple 
> clients better. 

Parallelizing definitely does help.  Still, even if we got local-like
performance with 10 clients running and the server completely handled
that load without slowing down any of the clients, we're still looking
at over 6 months of continuous upload.

I think a different approach is needed.

I'm planning to explore the ruby code a bit more to see how it interacts
with the database.

-- Dave





More information about the dev mailing list