[HOT] Improving the quality of OpenStreetMap Data

John Whelan jwhelan0112 at gmail.com
Mon Mar 6 20:44:32 UTC 2023


There are two issues the first is an exact duplicate I think these could 
be handled by a bot, if the way and tags are the same at the same position.

The second is pure bad mapping where a building can be mapped two or 
three times.  It's rare that these buildings are squarely mapped.  Some 
mappers are given the advice ignore what is there and just map.

Not an easy one to solve but at least they can be picked out with the 
right tools.  They aren't worth running on one tile of a project though.

The bigger problem is validator fatigue, they know it takes 3 clicks to 
map a building using a tool, then you ask them to sort out someone 
else's mess and it takes more than 3 clicks to sort out one building.

Cheerio John

Mike Thompson wrote on 3/6/2023 3:36 PM:
> Hi John,
>
> While I agree with you that we should get a building tool into the 
> hands of all mappers one way or the other, I wonder if the problem of 
> exact duplicate buildings is due to poor network connectivity (client 
> thinks upload failed, so upon the next upload the same data is 
> uploaded a second time).
>
> Mike
>
> On Mon, Mar 6, 2023 at 10:26 AM John Whelan <jwhelan0112 at gmail.com 
> <mailto:jwhelan0112 at gmail.com>> wrote:
>
>     I'm thinking of putting myself up as the unmapper of the year. 
>     Over the last few days I've deleted more than 500 duplicate
>     buildings. They're actually quite easy to spot with the right tools.
>
>     My favourite of the week is the mapper who retagged
>     highway=residential as road=yes.  Very difficult to spot.  Now if
>     he had been taught only to use the buildings_tool and nowt else
>     the problem wouldn't be there.
>
>     HOT has been after a building tool for id for many many years.  I
>     don't think it is ever going to happen.  It could be a limitation
>     in what you can do with a script in a browser or some other reason.
>
>     I think we need to rely on the business case that for buildings I
>     can get more buildings mapped with the buildings_tool for the same
>     number of mouse clicks.  I think it's six including the tag for iD
>     compared to two or three for the buildings_tool so you get two to
>     three times as many buildings out of the same mappers in the same
>     time period, besides that the validators and other OSM users will
>     love you.  As a general tool for an introduction to OSM making
>     small changes to many different objects iD is fine but for new
>     mappers you need something simpler with less choices. The more
>     choices they have the more likely they will choose the wrong one.
>
>     Cheerio John
>
>     Frans Schutz wrote on 3/6/2023 9:49 AM:
>>     Hi John, good to see you are still active with mapping.
>>     I agree with your point about the building tool, most mappers I
>>     review use this tool when they map in JOSM.
>>     However, most mappers, mostly new mappers use Ideditor and think
>>     they can map when they just roads the instructions. They often
>>     make mess of it and gives a lot of work to validators. A tool in
>>     Ideditor which produce fair squared buildings should be of great
>>     help.
>>
>>     Vriendelijke groeten
>>     Frans
>>
>>>     Op 6 mrt. 2023 om 3:37 PM heeft John Whelan
>>>     <jwhelan0112 at gmail.com> <mailto:jwhelan0112 at gmail.com> het
>>>     volgende geschreven:
>>>
>>>      I think the single most important thing HOT can do to improve
>>>     data quality is to use JOSM buildings_tools plugin to map
>>>     buildings.  It can be run from a USB stick and works fine with
>>>     Microsoft OPENJDK so you don't need to install JOSM on the
>>>     machine. Yesterday I added more than 200 building=yes tags to
>>>     untagged ways.  It takes a few more moments to train but
>>>     requires fewer mouse clicks per building and normally you get at
>>>     least 50% more buildings mapped out of brand new untrained
>>>     mappers in a 45 minute period.  You don't need to train them on
>>>     every bit of JOSM just enough to use the tool and upload.
>>>
>>>     Cheerio John
>>>
>>>     Samson Ngumenawe via HOT wrote on 3/6/2023 12:36 AM:
>>>>
>>>>     Dear OpenStreetMap Contributors,
>>>>
>>>>
>>>>     As we are working to ensure that the OpenStreetMap data is of
>>>>     good quality and fit for purpose, on behalf of the Humanitarian
>>>>     OpenStreetMap Team would like to reach out to the entire
>>>>     OpenStreetMap community, to help us achieve this goal.
>>>>
>>>>
>>>>     As you are aware, good-quality data is essential for effective
>>>>     humanitarian response and disaster management. Accurate and
>>>>     up-to-date geospatial information is critical in ensuring that
>>>>     aid and assistance can be delivered to those who need it most.
>>>>     However, maintaining data quality in a rapidly changing
>>>>     environment is challenging. We recognize that this is an
>>>>     ongoing process and need support from the OSM contributing
>>>>     community to help improve data quality continuously.
>>>>
>>>>
>>>>     At the Humanitarian OpenStreetMap Team, I am working towards
>>>>     implementing various measures to ensure the data created from
>>>>     remote mapping, field data, and imports is of quality. These
>>>>     measures include data validation, data quality checks and
>>>>     metrics, community engagement, and partnerships with other
>>>>     organizations like HeiGIT.
>>>>
>>>>     To build a pool of experienced data quality enthusiasts, HOT
>>>>     also conducts mapping events, internship training programs, and
>>>>     outreach initiatives to help engage the communities to create
>>>>     awareness and improve data quality.
>>>>
>>>>     Some of the data quality improvement efforts include;
>>>>
>>>>      *
>>>>
>>>>         Top 10 data quality aspects. I have defined our top 10 data
>>>>         quality aspects that we are focusing our efforts on
>>>>         (https://wiki.openstreetmap.org/wiki/Humanitarian_OSM_Team/top_10_data_quality_aspects)
>>>>         to let the community know about the sources of the errors
>>>>         and possible ways of how such errors can be addressed. This
>>>>         is the basis for a set of data quality metrics
>>>>         (https://wiki.openstreetmap.org/wiki/Humanitarian_OSM_Team/Core_Impact_Area_Datasets_,_Use_cases_%26_Data_Quality_Metrics)
>>>>         that I am working on and will be implementing to help us
>>>>         track the quality of data in the context of the most
>>>>         important data uses in humanitarian response and along
>>>>         community priorities. HOT has now dedicated data quality
>>>>         staff in all of our Hub teams - Dinar Adiatma for Asia
>>>>         Pacific, Shamillah Nassozi in East/Southern Africa, and
>>>>         Omowonuola Akintola in West & Northern Africa. Together
>>>>         with the regional Hub teams, we are creating
>>>>         regional-specific approaches on how to address data quality
>>>>         issues in their local context by defining data quality,
>>>>         regional needs, tools that track data quality issues, and
>>>>         solving them. Please read and provide feedback about the
>>>>         data quality approach
>>>>         (https://wiki.openstreetmap.org/wiki/Humanitarian_OSM_Team/Open_Mapping_Hub_-_Asia_Pacific/Data_Quality_Approach)
>>>>         for the Open Mapping Hub Asia-Pacific. These will all be
>>>>         based on the global Data quality strategy for which I am
>>>>         currently defining the strategic objectives for each team
>>>>         that will be collaborating on implementing the strategy and
>>>>         soon I will be sharing the draft data quality strategy for
>>>>         public review here as well.
>>>>
>>>>      *
>>>>
>>>>         I am working with the Quality Control Working Group to
>>>>         build an active team of global data validators
>>>>         (https://tasks.hotosm.org/teams/7/membership/) whose
>>>>         efforts are incredible in ensuring the quality of remotely
>>>>         mapped data is good. From the recent Turkey/Syria mapping
>>>>         activations, the validators have played a big role in
>>>>         checking and fixing the errors and improved the quality of
>>>>         the data that is being used to provide response to the
>>>>         disaster-impacted communities in Turkey and Syria. In the
>>>>         current response as well, we are seeing a lot of new and
>>>>         inexperienced mappers join. Yes, there are areas where
>>>>         quality is not good enough currently and I’m really
>>>>         grateful to everyone that is helping us improve and
>>>>         validate map data.
>>>>
>>>>
>>>>     I am calling on all OpenStreetMap contributors to help us in
>>>>     this effort to improve OpenStreetMap data quality continuously
>>>>     and I invite you to share your expertise, insights, and
>>>>     feedback on how we can work together to improve & maintain good
>>>>     quality data.
>>>>
>>>>     I am always openly available for a chat/call and in case you
>>>>     have any feedback that you would like to share with me, do not
>>>>     hesitate to reach out to me by emailing
>>>>     samson.ngumenawe at hotosm.org
>>>>     <mailto:samson.ngumenawe at hotosm.org>or data at hotosm.org
>>>>     <mailto:data at hotosm.org>
>>>>
>>>>     Your support and contributions are vital in making
>>>>     OpenStreetMap a reliable and comprehensive resource for
>>>>     humanitarian aid and disaster response.
>>>>
>>>>
>>>>     Thank you
>>>>
>>>>
>>>>     -- 
>>>>     *
>>>>     *
>>>>     https://unsummit.hotosm.org/*
>>>>     *
>>>>
>>>>     *Samson Ngumenawe*
>>>>     Data Quality Coordinator
>>>>     samson.ngumenawe at hotosm.org <mailto:samson.ngumenawe at hotosm.org>
>>>>     Timezone: UTC+03:00 (Kampala, Uganda)
>>>>
>>>>     *Humanitarian OpenStreetMap Team*
>>>>     *Using OpenStreetMap for Humanitarian Response & Economic
>>>>     Development*
>>>>     web <http://hotosm.org/> | twitter
>>>>     <https://twitter.com/hotosm> | facebook
>>>>     <https://www.facebook.com/hotosm> | donate
>>>>     <https://donate.hotosm.org/>
>>>>
>>>>
>>>>     _______________________________________________
>>>>     HOT mailing list
>>>>     HOT at openstreetmap.org <mailto:HOT at openstreetmap.org>
>>>>     https://lists.openstreetmap.org/listinfo/hot
>>>
>>>     -- 
>>>     Sent from Postbox <https://www.postbox-inc.com>
>>>     _______________________________________________
>>>     HOT mailing list
>>>     HOT at openstreetmap.org <mailto:HOT at openstreetmap.org>
>>>     https://lists.openstreetmap.org/listinfo/hot
>
>     -- 
>     Sent from Postbox <https://www.postbox-inc.com>
>     _______________________________________________
>     HOT mailing list
>     HOT at openstreetmap.org <mailto:HOT at openstreetmap.org>
>     https://lists.openstreetmap.org/listinfo/hot
>

-- 
Sent from Postbox <https://www.postbox-inc.com>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/hot/attachments/20230306/b9f57e9f/attachment.htm>


More information about the HOT mailing list