[OSM-dev] Bulk tile download tool using Java?

[Jon Burgess]

On Sat, 2008-03-08 at 16:43 +0100, Marcus Wolschon wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
> 
> 
> Hello Jon,
> 
> that may have been the SmoothTilePainter of Traveling Salesman.
> If the aspect-ratio of the window leaves space above or below
> the earth it tries to download that bit as well. (Only if no
> local map of the area to render is avaliable.)

There is another Java application making lots of invalid requests today.
A single IP address has made about 1M requests which have all been
invalid and returned 404 errors.

[12/Mar/2008:18:22:36 +0000] "GET /2147483647/2/1.png HTTP/1.1" 404 314 "-" "Java/1.5.0_13"
[12/Mar/2008:18:22:36 +0000] "GET /2147483647/2/1.png HTTP/1.1" 404 314 "-" "Java/1.5.0_13"
[12/Mar/2008:18:22:36 +0000] "GET /20/578828/383317.png HTTP/1.1" 404 316 "-" "Java/1.5.0_13"
[12/Mar/2008:18:22:36 +0000] "GET /2147483647/2/1.png HTTP/1.1" 404 314 "-" "Java/1.5.0_13"
[12/Mar/2008:18:22:36 +0000] "GET /20/578828/383317.png HTTP/1.1" 404 316 "-" "Java/1.5.0_13"
[12/Mar/2008:18:22:36 +0000] "GET /2147483647/2/1.png HTTP/1.1" 404 314 "-" "Java/1.5.0_13"
[12/Mar/2008:18:22:36 +0000] "GET /2147483647/2/1.png HTTP/1.1" 404 314 "-" "Java/1.5.0_13"
[12/Mar/2008:18:22:36 +0000] "GET /20/578828/383317.png HTTP/1.1" 404 316 "-" "Java/1.5.0_13"

I have just implemented a 3 second penalty for servicing any HTTP
request for a tile which is 'out of bounds'. This should reduce the
effect that a bad client like this will have on our servers.

I'm open to other suggestions of what mechanisms we might add to deal
with rogue clients. As OSM becomes even more popular we are bound to get
more clients making bad requests.

	Jon