[OSM-dev] 0.6 bulk uploader

Frederik Ramm frederik at remote.org
Thu Jan 22 03:37:49 GMT 2009


Hi,

Stefan de Konink wrote:
> Where do we need a limit? 

I assume that while doing all the inserts, the Ruby code has to keep 
track of all the Ids involved in order to be able to adjust the 
references in other objects. This will consume memory which is a limited 
resource. Also, it is my assumption that any transaction that is open 
over a prolonged period of time will create extra complexities on the 
database side (locks etc.), making very long-lasting transactions 
unwanted/difficult.

I'd rather impose an arbitrary limit which is much smaller than what the 
servers can theoretically handle and publish this so that whoever 
uploads something has a chance to be relatively sure that his query will 
work - instead of letting anyone upload an arbitrarily big diff that 
will give a Rails "out of memory" exception somewhere down the line.

Bye
Frederik

-- 
Frederik Ramm  ##  eMail frederik at remote.org  ##  N49°00'09" E008°23'33"




More information about the dev mailing list