[OSM-dev] TIGER upload automation

[Tom Hughes]

In message <46D6FAC1.4000906 at arjam.net>
          "Robert (Jamie) Munro" <rjmunro at arjam.net> wrote:

> Dave Hansen wrote:
> 
> > As a result, it's chewing up more CPU than it was on my laptop (~25% of
> > a cpu). But, the memory footprint is still staying pretty small.
> 
> If you run two uploads in parallel, how does that change things? It
> could be anywhere between both uploads going half the speed or even
> slower as they use up memory that could be better used by the other,
> meaning no overall improvement, or it might run twice as fast overall,
> which would bring the total wait down to 9 months, which is worth doing.

But please, please be careful if you're to run multiple copies in
parallel... Keep an eye on:

  http://munin.openstreetmap.org/openstreetmap/www.openstreetmap-lighttpd_processes.html

Those graphs show the number of active requests being handled by
the web server and if they start to spike upwards due to being
overloaded by work then everything will slow down...

Tom

-- 
Tom Hughes (tom at compton.nu)
http://www.compton.nu/