[OSM-dev] buulk_uploads use up all CPU on dev...

Robert (Jamie) Munro rjmunro at arjam.net
Tue Sep 18 16:48:42 BST 2007


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Martijn van Oosterhout wrote:
> On 9/17/07, spaetz <osm at sspaeth.de> wrote:
>> dev's CPU is used up 100%. both your bulk_upload scripts have started using up everything available. So it seems part of your slowness is not the API's slowness, but CPU limitations of dev. Is there a reason why they are so CPU intensive?
> 
> Ok, I think daveh fixed his script already.
> 
>> Would you guys care to run your uploads somewhat niced too (say at -n 5)? Plus it's weird that it started using so much CPU, I can't recall it using that much before.
> 
> Looking at the stats, it costs about 4ms of processing per object to
> upload. At the current rate of upload that does work out around the
> 3-4% CPU usage, which is what ps is showing.

How is the AND upload going? Can we see stats somewhere?

Robert (Jamie) Munro
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFG7/NWz+aYVHdncI0RAs3WAKCgN5rp0TkHcWj238mqmtb+2HbwPQCg0L91
lJN514s4GXzjO8NgsFqCcvk=
=eL9q
-----END PGP SIGNATURE-----




More information about the dev mailing list