[OSM-talk] Announcing Daylight Map Distribution

Tue Mar 10 22:17:57 UTC 2020

Thanks Mikel for your followup!

In response to your recommendation that we publish what *didn't* make it through the filter process, we released an OSC diff file:

	https://daylight-map-distribution.s3.amazonaws.com/pbf/planet-2020-03-06_v0.1.osc.bz2 <https://daylight-map-distribution.s3.amazonaws.com/pbf/planet-2020-03-06_v0.1.osc.bz2>

At this early stage of trying to determine what’s useful for the community, it’s pretty raw. The OSC does not yet differentiate between things we filtered out categorically because we don't show them on our maps, vs. things we filtered out individually because we found a problem with them. Individual tree nodes are an example of the former: they don't get shown or labeled so they’re not in Daylight.

I appreciate everyone’s questions about this data release. The FB team behind Daylight and our other mapping efforts is well aware that OSM is a tough and curious community!

-mike.

----------------------------------------------------------------
michal migurski- contact info and pgp key:
sf/ca            http://mike.teczno.com/contact.html

> On Mar 10, 2020, at 1:20 PM, Mikel Maron <mikel.maron at gmail.com> wrote:
> 
> Thanks Mike and Facebook for doing this. I commented on your diary post, but also adding to the coversation here. It's great to have this insight out and available. There's a good tradition of downstream data processing and redistribution in the community (you could call them packages I supposed) -- from GeoFabrik's regional and country downloads, to OSMQATiles, etc.
> 
> 
> In this case (and I focused on this when we spoke), I'm not sure that the most valuable thing to distribute is what made it through Facebook filters, but rather what didn't make it through and why. That insight is valuable to identify problems that need fixing on a faster basis, notify local communities and other editors, and to build up a corpus of understanding of what problematic edits in OSM look like.
> 
> 
> The most actionable way to do this distribution will be through OSMCha. Through the OSMCha API, you can flag changesets/features with reasons, and can be set up so that any reason tag by Facebook has a "Facebook:" prefix.
> 
> 
> This is what Mapbox has set up. The Mapbox Streets Review team looks at edits every day, and problems are flagged and surfaced in OSMCha. You can see all of this [with this OSMCha filter](https://osmcha.org/?aoi=083b147b-a72c-4026-9db5-b70761a6795c). You'll see the most recent flag as about 3 days ago -- that's the typical time between OSM edit and review / publishing in Mapbox Streets.
> 
> 
> Adding in Facebook flagged problems to OSMCha would provide even stronger signal of problems, and hope to explore implementing it with you all.
> 
> -Mikel
> 
> * Mikel Maron * +14152835207 @mikel s:mikelmaron
> 
> 
> 
> 
> 
> 
> On Monday, March 9, 2020, 08:10:29 PM EDT, Michal Migurski <mike at teczno.com> wrote: 
> 
> 
> 
> 
> 
> Hi everyone,
> 
> I’m writing to let you know about a new OpenStreetMap project Facebook just released. It’s called Daylight Map Distribution. Daylight is a complete, downloadable preview of OpenStreetMap data we plan to start using in a number of our public maps:
> 
>     https://www.openstreetmap.org/user/migurski/diary/392416
> 
> Facebook uses maps to let our users find friends, businesses, groups and more. OpenStreetMap (OSM) has a substantial global footprint of map data built and maintained by a dedicated community of global mappers and it’s a natural choice for us. Every day, OSM receives millions of contributions from the community. Some of these contributions may have intentional and unintentional edits that are incompatible with our needs. Our mapping teams work to scrub these contributions for consistency and quality. 
> 
> What’s Included in the Daylight Map Distribution:
> 
>     • A PBF planet file composed of 100% OSM data, released under the terms of the Open Database License.
>     • Only those edits which have been validated to contain no malicious vandalism or unintentional errors so we can show them in our display maps
> 
> This is just an initial first release, and we’re looking for feedback from the community to decide what would be useful to release in the future and how frequently. I’d be interested to hear any response you might have about it!
> 
> -mike.
> 
> ----------------------------------------------------------------
> michal migurski- contact info and pgp key:
> sf/ca            http://mike.teczno.com/contact.html
> 
> 
> _______________________________________________
> talk mailing list
> talk at openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/talk/attachments/20200310/01f1bcd9/attachment-0001.htm>