[josm-dev] Slower upload of .osm after progress indicator added?

Shaun McDonald osm at shaunmcdonald.me.uk
Fri Jul 3 08:47:34 BST 2009


It would be more useful to know the number of changes (nodes, ways and  
relations) rather than the size of the file you are uploading. The  
diff/atomic uploads compared to the older item by item upload, tend to  
be faster for small to medium sized data. However for huge uploads it  
will probably be slower.

Are you comparing the last upload to before API 0.6?

If you want to do benchmarking, please use the test server http://api06.dev.openstreetmap.org/ 
  so that you don't upload a lot of junk data in to the live database.  
(Though this sort of thing may have different limits).

I would also recommend uploading in smaller chunks.

Shaun

On 3 Jul 2009, at 07:21, Tyler wrote:

> Hello all,
>
> I think--but I'm not sure--that the addition of the progress  
> indicator (yay
> progress indicator!) may have slowed down uploads. I did a pretty
> substantial 90,000 node upload a while back and it took ~4.5 hours.  
> I'm
> currently using 1720 and it takes ~12 hours for 50,000 nodes. JOSM  
> seems to
> be handling edge cases much better than any of the bulk upload  
> scripts at
> this point and 4.5 hours wasn't that bad but 12 hours to upload 5 mb  
> of data
> seems a bit high even with an upload of 1 megabit (and all of the  
> overhead
> for does this node exist, no? make the node, the new node number is  
> ##).
> I can't imagine the math done for the progress bar is slowing things  
> down
> that much and I've only just begun checking out the sources and I'm  
> not
> particularly skilled with Java (as in, very very unskilled) so I  
> thought I
> would check to see if either A) I'm just wrong and my estimate for the
> original upload of 90,000 nodes was wrong or B) anyone had any  
> insight as to
> what might be slowing things down.
>
> I'll see about running some benchmarks tomorrow with whatever latest  
> is then
> (I see 1721 was committed) and a build from a couple of weeks ago.
>
> Thanks,
>
> Tyler
> _______________________________________________
> josm-dev mailing list
> josm-dev at openstreetmap.org
> http://lists.openstreetmap.org/listinfo/josm-dev





More information about the josm-dev mailing list