[OSM-dev] legitimate IP blocked

Kai Krueger kakrueger at gmail.com
Sun Jun 5 03:04:14 BST 2011


Mikel Maron wrote:
> 
> Uganda mapping party doing lots of good work today, got IP blocked.
> 

Others have reported similar problems[1], and I'd suspect that a number of
mapping parts will hit the same issue as it is probably fairly common to
proxy a whole network through a single IP. Furthermore, even individual
mappers have reported hitting the IP limit when mapping with P2.

I presume that the issue is the bandwidth throttling code in cgi_map, which
was implemented to prevent people and applications from scraping large areas
from the API instead of using planet extracts. It is implemented as a leaky
bucket style throttling code per IP address, storing the amount of draw from
the bucket in memcached.

It is perhaps somewhat of an ugly hack, but would probably be fairly easy to
implement and hopefully alleviate the issue somewhat. Would it be possible
to stick a line into the diff upload controller in the rails_port that
resets the bytes sent counter for the given IP in memcached every time
someone uploads something? This way mappers who upload things would have
much more leeway with the bandwidth limit than scrapers who only download.

Kai

[1]
http://help.openstreetmap.org/questions/5438/how-to-avoid-potlatch-2-download-limit-when-editing-on-multiple-computers-on-a-network


--
View this message in context: http://gis.638310.n2.nabble.com/legitimate-IP-blocked-tp6439322p6441104.html
Sent from the Developer Discussion mailing list archive at Nabble.com.



More information about the dev mailing list