[HOT] Map-a-thon getting 509 Bandwidth Exceeded error

[Blake Girardot]

Hi Nick,

Just to be complete for future reference as I had not heard of it before 
and I can see it happening to other HOT mapping groups in the future:

We think this is not related to HOT or the Tasking Manager.

We suspect that it is related to OpenStreetMap in general and the 
process of downloading the already existing data from OSM to your local 
users.

Althio was suggesting you speak to the OSM system administrators via the 
general OSM email lists or IRC.

It looks like you might have already followed up in IRC or someone with 
the same problem did and the edited exchange is below.


===============================================

<User> we were able to load our imagery and save data into OSM, but were 
unable to download the existing data into the editor. I looked at the 
network logs and everything was coming up 509 bandwidth exceeded

<User> it subsided later, but would come back, sort of like we were 
getting throttled access.

<OSMSysAdmin> you just need to shout on here with your IP address and we 
can apply a temporary fix

<OSMSysAdmin> unfortunately there is no way to "book" the fix in advance 
- it has to be applied at the time that the problem occurs

<OSMSysAdmin> and yes throttling is exactly what is going on

<User> ok, in 12 hours from now can I do a ping? or does it gradually go 
back to normal?

<OSMSysAdmin> it caps you to about 100Kbyte/second with a maximum debt 
of 250Mbytes - once you have downloaded 250Mbytes downloads will be 
blocked but that debt will decay away at 100Kbyte/second so yes, it will 
go back to normal over time once you stop

<OSMSysAdmin> it should only take about 45 minutes to clear if you stop 
completely

<User> the venue might have a limited number of IP addresses which could 
be behind the problem

<OSMSysAdmin> the limit is per address so if it is natting or proxying 
people then that is likely the issue

<User> I'll pop back onto #osm-dev in the morning and have our IP 
addresses ready in case anything happens

<User> ok this is all good to know. I wasn't aware this could happen 
with normal editing, but I guess we have a good number of people and 
some dense data already uploaded into the system
=====================================================



On 6/20/2015 2:57 PM, althio wrote:
> Hi Nicholas,
>
> I would say the general mailing list 'talk' or the technical working
> group may be better suited than the HOT list for your request.
>
> See also:
> http://wiki.openstreetmap.org/wiki/API_usage_policy
> "To avoid having your access blocked, please discuss your requirement
> with system administrators either via their wiki pages or on the IRC
> channel prior to starting."
> http://wiki.openstreetmap.org/wiki/System_Administrators
>
> Apart from that, some free and unchecked advice:
>   - consider offline editor JOSM
>   - use iD with zoom close in, not downloading large areas
>
> Best of luck.
>
> althio
>
>
> On 20 June 2015 at 08:43, Nicholas Doiron <nickd at codeforamerica.org> wrote:
>> Hi,
>>
>> I'm working with The Asia Foundation to run an OpenStreetMap map-a-thon in
>> Ulaanbaatar, Mongolia. We have 17 teams of 3 people, mostly students and
>> city planners, mapping unplanned areas of the city (ger districts)
>>
>> At 3:30pm local time, we got a 509 Bandwidth Exceeded error on most teams'
>> machines, so we had to end our first day early.  No one's data is lost, but
>> we can't download existing data into iD, so every map area looks blank.
>> There was a risk we would add the same building many times.
>>
>> Is there a way for us to re-enabling editing before tomorrow morning? And
>> keep the gates open for another 48 hours or so?
>> I'll do my part by closing a couple of apps (including Show Me The Way from
>> OSM Labs) which were running at the time
>>
>> Regards,
>> Nick Doiron
>>
>> _______________________________________________
>> HOT mailing list
>> HOT at openstreetmap.org
>> https://lists.openstreetmap.org/listinfo/hot
>>
>
> _______________________________________________
> HOT mailing list
> HOT at openstreetmap.org
> https://lists.openstreetmap.org/listinfo/hot
>