[OSM-talk] how long does it take from edit to slippy map?

Frederik Ramm frederik at remote.org
Fri Feb 23 23:18:50 GMT 2007


Hi,

 > I think there are some automated RSS feeds that flag up areas that
 > have been changed.

Yes, but not all changes are picked up by the feed used for tiles at home. 
If people upload many changes at once, or many people upload changes at 
once, then the feed may miss some of them. Another reason to "save 
early, save often" in JOSM.

 > I know that I & a whole bunch of people are running tiles at home scripts
 > that probably turn around a request for a re-render to uploading the
 > tiles in an hour or so.

The combined throughput of alle tiles at home participants is between 100 
and 400 tilesets per hour (a tileset being a level-12 tile and all 
level-13 to level-17 tiles contained therein). Of course rendering an 
individual tile will take longer than 1/100 of an hour but it seldom 
takes a full hour.

 > I guess that once those tiles are on the server they need to be
 > moved to where the slippy map can get at them.

The tiles at home upload receiver script unzips the tiles and stuffs them 
into the database immediately. *If* the database is available ;-), so 
there's not a big delay there.

tiles at home is quite efficient, but it is handicapped (at the moment) by 
a database overload ("too many mysql connections", broken images in the 
slippy map, sometimes willing renderers can't even be assigned a job 
from the queue because the database is unavailalbe). Also, once 
tiles at home has distributed your rendering request(s) to clients, it has 
no control about what they do. If one of the clients gobbles up the 
request but the upload is broken (or the machine went offline by the 
time there is data to upload), then your request may sit in the "being 
rendered" queue for quite some time, and you can't even re-request it.

If you want a particular tile re-rendered, it doesn't hurt to trigger 
rendering through the tile browser or informationfreeway.org, or even 
(if you're a Unix user) do what I do when I have made a lot of changes 
to the Karlsruhe map:

for x in 2142 2143 2144
do
     for y in 1405 1406 1407
     do
	wget -qO /dev/null "http://dev.openstreetmap.org/~ojw/NeedRender/?x=$x&
y=$y&priority=1&src=fred_rendering_karlsruhe"
     done
done

(modify according to your needs, and of course do that only if you have 
actually changed something, not from a cron job!)

 > So whats typical? If I get lucky could I see the changes in under an
 > hour?

You can watch it for yourself at 
http://dev.openstreetmap.org/~ojw/Log/Requests/ (database load 
permitting). If I request nine tiles like sketched above, and the queue 
is empty before (which it almost always is), the first results pop up 
after 15 to 20 minutes, but it can be several hours until the last tile 
is rendered.

 > What I've outlined I think is for the osmarender layer, what about the
 > mapnik layer - how long does that take from edit to shiney new tile?
 > Is that typically faster?

Mapnik is much faster than osmarender, but not used in a distributed 
environment which sort of nullifies that advantage. I believe there's a 
mechanism that will re-render tiles that have been looked at, but AFAIK 
it always uses the latest planet file, so if you change something on 
Wednesday afternoon, it will be at least 7 days until you see it up on 
the Mapnik layer. (Not a Mapnik expert though, may be wrong here.)

Bye
Frederik

-- 
Frederik Ramm  ##  eMail frederik at remote.org  ##  N49°00.09' E008°23.33'





More information about the talk mailing list