<html><body><div style="color:#000; background-color:#fff; font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:10pt"><div class="" style=""><span class="" style="">Hi</span></div><div style="color: rgb(0, 0, 0); font-size: 13.63636302947998px; font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', sans-serif; font-style: normal; background-color: transparent;" class=""><span class="" style=""><br class="" style=""></span></div><div style="color: rgb(0, 0, 0); font-size: 13.63636302947998px; font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', sans-serif; font-style: normal; background-color: transparent;" class=""><span class="" style=""><span style="font-family: 'Helvetica Neue', 'Segoe UI', Helvetica, Arial, 'Lucida Grande', sans-serif; font-size: 12.727272033691406px;" class="">> So I suppose the reasoning was that it was worth sacrificing having a
complete DC address database in order to avoid re-importing a </span></span></div><div style="color: rgb(0, 0, 0); font-size: 12.727272033691406px; font-family: 'Helvetica Neue', 'Segoe UI', Helvetica, Arial, 'Lucida Grande', sans-serif; font-style: normal; background-color: transparent;" class=""><span class="" style=""><span style="font-family: 'Helvetica Neue', 'Segoe UI', Helvetica, Arial, 'Lucida Grande', sans-serif; font-size: 12.727272033691406px;" class="">> bunch of footprints that already exist.</span><br class="" style=""></span></div><div class="" style=""></div><div class="" style=""> </div><div class="" style="">Really, the reason was to make the first import process with OCTO straight forward. We can now think towards what it would take to do merging. Would require a similar compilation of OCTO data for remaining area, and we can ask OCTO for help with that. But from then, what would be the process? I'm thinking that analysis
of differences and maybe production of a tile set highlighting merge cases to focus on would be helpful.</div><div class="" style=""><br class="" style=""></div><div class="" style="">> <span style="font-family: 'Helvetica Neue', 'Segoe UI', Helvetica, Arial, 'Lucida Grande', sans-serif; font-size: 12.727272033691406px;" class="">I think better documentation on the wiki and even github would have been in order, since much of these decisions appeared to have been </span></div><div class="" style=""><span style="font-family: 'Helvetica Neue', 'Segoe UI', Helvetica, Arial, 'Lucida Grande', sans-serif; font-size: 12.727272033691406px;" class="">> been made offline.</span></div><div class="" style=""><span style="font-family: 'Helvetica Neue', 'Segoe UI', Helvetica, Arial, 'Lucida Grande', sans-serif; font-size: 12.727272033691406px;" class=""><br class="" style=""></span></div><div class="" style=""><font face="Helvetica Neue, Segoe UI,
Helvetica, Arial, Lucida Grande, sans-serif" class="" style=""><span style="font-size: 12.727272033691406px;" class="">We can always document better. Anyone here could help update the wiki with key points from this thread.</span></font></div><div class="" style=""><br></div><div class="" style=""><font face="Helvetica Neue, Segoe UI, Helvetica, Arial, Lucida Grande, sans-serif" class="" style=""><span style="font-size: 12.727272033691406px;" class="">> This may be what someone else was concerned about when they mentioned reservations about an import being conducted primarily by </span></font></div><div class="" style=""><font face="Helvetica Neue, Segoe UI, Helvetica, Arial, Lucida Grande, sans-serif" class="" style=""><span style="font-size: 12.727272033691406px;" class="">> a local government. It's great that OCTO have taken the initiative, but their priorities and concerns would naturally not exactly be
in </span></font></div><div class="" style=""><font face="Helvetica Neue, Segoe UI, Helvetica, Arial, Lucida Grande, sans-serif" class="" style=""><span style="font-size: 12.727272033691406px;" class="">> alignment with those of the OSM community.<br class="" style=""></span></font></div><div class="" style=""><font face="Helvetica Neue, Segoe UI, Helvetica, Arial, Lucida Grande, sans-serif" class="" style=""><span style="font-size: 12.727272033691406px;" class=""><br class="" style=""></span></font></div><div class="" style=""><font face="Helvetica Neue, Segoe UI, Helvetica, Arial, Lucida Grande, sans-serif" class="" style=""><span style="font-size: 12.727272033691406px;" class="">That's not really the case. Certainly OCTO initiated this effort, and commendation is appropriate. But from there, several of us in the OSM community talked with OCTO about what will work, and we did discuss in several forums. But we can always do better. And in that
vein, glad we're getting into these details on this thread.</span></font></div><div class="" style=""><font face="Helvetica Neue, Segoe UI, Helvetica, Arial, Lucida Grande, sans-serif" class="" style=""><span style="font-size: 12.727272033691406px;" class=""><br></span></font></div><div class="" style=""><font face="Helvetica Neue, Segoe UI, Helvetica, Arial, Lucida Grande, sans-serif" class="" style=""><span style="font-size: 12.727272033691406px;" class="">That all being said, what do we do next Mapping DC?</span></font></div><div class="" style=""><font face="Helvetica Neue, Segoe UI, Helvetica, Arial, Lucida Grande, sans-serif" class="" style=""><span style="font-size: 12.727272033691406px;" class=""><br></span></font></div><div class="" style=""><font face="Helvetica Neue, Segoe UI, Helvetica, Arial, Lucida Grande, sans-serif" class="" style=""><span style="font-size: 12.727272033691406px;" class="">Mikel</span></font></div><div class="" style="">*
Mikel Maron * +14152835207 @mikel s:mikelmaron</div> <div class="qtdSeparateBR"><br><br></div><div class="yahoo_quoted" style="display: block;"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 10pt;" class=""> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 12pt;" class=""> <div dir="ltr" class="" style=""> <font size="2" face="Arial" class="" style=""> On Friday, August 8, 2014 10:39 AM, Brandon Knight <bknight430@gmail.com> wrote:<br class="" style=""> </font> </div> <blockquote style="border-left: 2px solid rgb(16, 16, 255); margin-left: 5px; margin-top: 5px; padding-left: 5px;" class=""> <br class="" style=""><br class="" style=""> <div class="" style=""><div id="yiv9657873962" class="" style=""><div class="" style=""><div dir="ltr" class="" style=""><div class="" style="">Thanks, David and Mikel. After
digging through the github repo, I was able to find the information I was looking for in the makefile and corresponding commit comment[1]. Apparently, the decision was made not to use the full DC buildings dataset but a partial dataset produced by OCTO. So I suppose the reasoning was that it was worth sacrificing having a complete DC address database in order to avoid re-importing a bunch of footprints that already exist.</div>
<div class="" style=""><br clear="none" class="" style=""></div><div class="" style="">I'm fairly new to community. I think better documentation on the wiki and even github would have been in order, since much of these decisions appeared to have been been made offline. Anyone jumping in now should be able to easily follow the details of the plan, including why choices were made, without digging through the code or commit messages.</div>
<div class="" style=""><br clear="none" class="" style=""></div><div class="" style="">This may be what someone else was concerned about when they mentioned reservations about an import being conducted primarily by a local government. It's great that OCTO have taken the initiative, but their priorities and concerns would naturally not exactly be in alignment with those of the OSM community.</div>
<div class="" style=""><br clear="none" class="" style=""></div><div class="" style="">With that being said, I applaud all of the hard work that has been done to make this happen.</div><div class="" style=""><br clear="none" class="" style=""></div><div class="" style="">-Brandon</div>
<div class="" style=""><br clear="none" class="" style=""></div><div class="" style="">[1] <a rel="nofollow" shape="rect" target="_blank" href="https://github.com/osmlab/dcbuildings/commit/117b1a7636eb04d70e7876eac88eabf6f9b60fc2" class="" style="">https://github.com/osmlab/dcbuildings/commit/117b1a7636eb04d70e7876eac88eabf6f9b60fc2</a><br clear="none" class="" style="">
</div><div class="" id="yiv9657873962yqt06625" style=""><div class="" style="">
<br clear="none" class="" style=""><div class="" style="">On Thu, Aug 7, 2014 at 9:22 AM, Mikel Maron <span dir="ltr" class="" style=""><<a rel="nofollow" shape="rect" ymailto="mailto:mikel.maron@gmail.com" target="_blank" href="mailto:mikel.maron@gmail.com" class="" style="">mikel.maron@gmail.com</a>></span> wrote:<br clear="none" class="" style=""><blockquote class="" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex;">
<div class="" style=""><div style="color:rgb(0,0,0);font-family:HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', sans-serif;font-size:10pt;background-color:rgb(255,255,255);" class=""><div class="" style=""><span class="" style="">> </span><font face="arial, sans-serif" style="font-size:12.727272033691406px;" class="">"</font><span style="font-size:13px;font-family:arial, sans-serif;" class="">Will this be taken care of in a separate process that I am unaware of?" No plans for that at this time. </span></div>
<div class="" style=""><span style="font-size:13px;font-family:arial, sans-serif;" class=""><br clear="none" class="" style=""></span></div><div class="" style=""></div><div class="" style="">But we (DC OSM community) can start thinking about it. Was decided that this after this first "easy" import pass, would look at this harder conflation import later.</div>
<div class="" style=""> </div><div class="" style="">* Mikel Maron * <a rel="nofollow" shape="rect" class="" style="" href="">+14152835207</a> @mikel
s:mikelmaron</div> <div class="" style=""><br clear="none" class="" style=""><br clear="none" class="" style=""></div><div style="display:block;" class=""> <div style="font-family:HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', sans-serif;font-size:10pt;" class=""> <div style="font-family:HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', sans-serif;font-size:12pt;" class="">
<div dir="ltr" class="" style=""> <font face="Arial" class="" style=""> On Thursday, August 7, 2014 8:19 AM, David Jackson (OCTO) <<a rel="nofollow" shape="rect" ymailto="mailto:davidy.jackson@dc.gov" target="_blank" href="mailto:davidy.jackson@dc.gov" class="" style="">davidy.jackson@dc.gov</a>> wrote:<br clear="none" class="" style=""> </font> </div> <blockquote style="border-left-width:2px;border-left-style:solid;border-left-color:rgb(16,16,255);margin-left:5px;margin-top:5px;padding-left:5px;" class="">
<br clear="none" class="" style=""><br clear="none" class="" style=""> <div class="" style=""><div class="" style=""><div class="" style=""><div dir="ltr" class="" style="">Brandon,<div class="" style=""><br clear="none" class="" style=""></div><div class="" style="">To answer your solid questions.</div><div class="" style=""><br clear="none" class="" style=""></div><div class="" style="">1) "<font style="font-size:13px;font-family:arial, sans-serif;" class=""> </font><span style="font-size:13px;font-family:arial, sans-serif;" class="">Are these chunks empty because there was found to be no difference from what already existed in OSM from previous imports?</span><span style="font-size:13px;font-family:arial, sans-serif;" class=""> "</span></div>
<div class="" style=""><span style="font-size:13px;font-family:arial, sans-serif;" class=""><br clear="none" class="" style=""></span></div><div class="" style=""><span style="font-size:13px;font-family:arial, sans-serif;" class="">No. There are many differences between existing building / address data in OSM and what is being loaded. Examples included have buildings tagged with addresses, geometry of data among others.</span></div>
<div class="" style=""><span style="font-size:13px;font-family:arial, sans-serif;" class=""><br clear="none" class="" style=""></span></div><div class="" style=""><span style="font-size:13px;font-family:arial, sans-serif;" class="">2) "</span><span style="font-family:arial, sans-serif;font-size:13px;" class="">Why was the decision made to use the tasking manager to conduct a partial import as opposed to conflating the entire dataset, given that the new import process is adding not only building footprints but footprints+addresses? "</span></div>
<div class="" style=""><span style="font-family:arial, sans-serif;font-size:13px;" class=""><br clear="none" class="" style=""></span></div><div class="" style=""><span style="font-family:arial, sans-serif;font-size:13px;" class="">The goal of the project was to 'complete' or fill in (almost 100%) the buildings (with address where they exist) for the rest of DC. This means over 50,000 buildings. The decision was made because to do a partial import because it would be much less time intensive.</span></div>
<div class="" style=""><span style="font-family:arial, sans-serif;font-size:13px;" class=""><br clear="none" class="" style=""></span></div><div class="" style=""><font face="arial, sans-serif" class="" style="">"</font><span style="font-family:arial, sans-serif;font-size:13px;" class="">Will this be taken care of in a separate process that I am unaware of?" No plans for that at this time. </span></div>
<div class="" style=""><span style="font-family:arial, sans-serif;font-size:13px;" class=""><br clear="none" class="" style=""></span></div><div class="" style=""><span style="font-family:arial, sans-serif;font-size:13px;" class="">- David</span></div><div class="" style=""><span style="font-size:13px;font-family:arial, sans-serif;" class=""><br clear="none" class="" style="">
</span></div></div><div class="" style=""><br clear="all" class="" style=""><div class="" style=""><div dir="ltr" class="" style=""><div class="" style="">David Jackson | GIS Analyst | Office of the Chief technology Officer<br clear="none" class="" style=""></div>
<div class="" style=""></div>
<div class="" style="">(W) <a rel="nofollow" shape="rect" class="" style="" href="">202.724.5135</a> | 200 I ST SE, 5TH FL, Washington, DC <br clear="none" class="" style=""></div><a rel="nofollow" shape="rect" ymailto="mailto:davidy.jackson@dc.gov" target="_blank" href="mailto:davidy.jackson@dc.gov" class="" style="">davidy.jackson@dc.gov</a> | Blog: <a rel="nofollow" shape="rect" target="_blank" href="http://dcaddresscoordinates.blogspot.com/" class="" style="">dcaddresscoordinates.blogspot.com</a><br clear="none" class="" style="">
<div class="" style=""><div class="" style="">Telework Day: Fri<br clear="none" class="" style=""></div></div></div></div>
<br clear="none" class="" style=""><br clear="none" class="" style=""><div class="" style="">On Wed, Aug 6, 2014 at 4:44 PM, Brandon Knight <span dir="ltr" class="" style=""><<a rel="nofollow" shape="rect" ymailto="mailto:bknight430@gmail.com" target="_blank" href="mailto:bknight430@gmail.com" class="" style="">bknight430@gmail.com</a>></span> wrote:<br clear="none" class="" style="">
<blockquote style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex;" class="">
<div class="" style=""><div dir="ltr" class="" style=""><div class="" style="">Posting this to the OSM Imports and the MappingDC lists:</div><div class="" style=""><br clear="none" class="" style=""></div>I've been reviewing the work by OCTO on DC building/address imports currently being conducted via the tasking manager[1] and I've noticed a few things that raised some questions about this plan. Excuse me if I don't understand this or if there are obvious answers to these questions. I'm new here.<div class="" style="">
<br clear="none" class="" style=""></div><div class="" style="">From my understanding, the current plan is to import all DC buildings and addresses in areas that were not imported in 2008-10. Tags were converted, building shapes simplified, and then the tags from MAR points[2] were joined to building footprints[3] when a building was found to contain only one address point, and the point deleted. Data was then split up into chunks by block group and converted to .osm files. Scripts found in the dcbuildings repo[4]</div>
<div class="" style=""><br clear="none" class="" style=""></div><div class="" style="">After loading some of block group chunks using the tasking manager I've found that many are completely empty (0 nodes). The explanation I was given by OCTO was:</div><div class="" style=""><br clear="none" class="" style="">
</div><div class="" style="">"<span style="font-family:arial, sans-serif;font-size:13px;" class=""> </span><span style="font-family:arial, sans-serif;font-size:13px;" class="">Many of the chunks created by mapbox did not contain any data, this is due to the fact that these areas already had complete or near complete building / addresses in OSM for that area."</span></div>
<div class="" style=""><br clear="none" class="" style=""></div><div class="" style=""><span style="font-family:arial, sans-serif;" class=""><br clear="none" class="" style=""></span></div><div class="" style=""><span style="font-family:arial, sans-serif;" class="">My questions are:</span></div><div class="" style=""><br clear="none" class="" style=""></div><div class="" style=""><font face="arial, sans-serif" class="" style="">1) </font><span style="font-family:arial, sans-serif;" class="">Are these chunks empty because there was found to be no difference from what already existed in OSM from previous imports?</span><span style="font-family:arial, sans-serif;" class=""> </span></div>
<div class="" style=""><span style="font-family:arial, sans-serif;" class=""><br clear="none" class="" style=""></span></div><div class="" style=""><span style="font-family:arial, sans-serif;" class="">I originally thought that the entire DC dataset would be represented in these chunks. If chunks containing only "diffs" was the plan, I couldn't find a clear description of this or representation in the code.</span></div>
<div class="" style=""><font face="arial, sans-serif" class="" style=""><br clear="none" class="" style=""></font></div><div class="" style=""><font face="arial, sans-serif" class="" style="">2) Why was the decision made to use the tasking manager to conduct a partial import as opposed to conflating the entire dataset, given that the new import process is adding not only building footprints but footprints+addresses? </font></div>
<div class="" style=""><font face="arial, sans-serif" class="" style=""><br clear="none" class="" style=""></font></div><div class="" style=""><font face="arial, sans-serif" class="" style="">I found examples of large areas of block groups with previously imported buildings lacking addresses that corresponded to empty chunk files. I looked at the raw data and these should contain buildings with joined address tags that could be copied to the existing buildings. Currently there are large swaths of buildings with no addresses. Will this be taken care of in a separate process that I am unaware of?</font></div>
<div class="" style=""><font face="arial, sans-serif" class="" style=""><br clear="none" class="" style=""></font></div><div class="" style=""><font face="arial, sans-serif" class="" style="">I also found previously imported buildings that does not exist in the current dataset (or in any satellite imagery that I could find). Since this import is semi-automated, wouldn't a comparison of the full dataset allowed for someone to spot this and remove it?</font></div>
<div class="" style=""><font face="arial, sans-serif" class="" style=""><br clear="none" class="" style=""></font></div><div class="" style=""><font face="arial, sans-serif" class="" style="">Thanks,</font></div><div class="" style=""><font face="arial, sans-serif" class="" style=""><br clear="none" class="" style=""></font></div><div class="" style=""><font face="arial, sans-serif" class="" style="">-Brandon</font></div>
<div class="" style="">
<span style="font-family:arial, sans-serif;" class="">@geobrando</span><br clear="none" class="" style=""></div><div class="" style=""><font face="arial, sans-serif" class="" style=""><br clear="none" class="" style=""></font></div><div class="" style=""><div class="" style="">[1]<a rel="nofollow" shape="rect" target="_blank" href="http://tasks.openstreetmap.us/job/6" class="" style="">http://tasks.openstreetmap.us/job/6</a></div>
</div><div class="" style="">[2]<a rel="nofollow" shape="rect" target="_blank" href="http://data.dc.gov/Metadata.aspx?id=190" class="" style="">http://data.dc.gov/Metadata.aspx?id=190</a></div><div class="" style="">[3]<a rel="nofollow" shape="rect" target="_blank" href="http://data.dc.gov/Metadata.aspx?id=59" class="" style="">http://data.dc.gov/Metadata.aspx?id=59</a></div>
<div class="" style="">
[4]<a rel="nofollow" shape="rect" target="_blank" href="https://github.com/osmlab/dcbuildings" class="" style="">https://github.com/osmlab/dcbuildings</a></div><div class="" style=""><br clear="none" class="" style=""></div></div></div>
<br clear="none" class="" style="">_______________________________________________<br clear="none" class="" style="">
Imports mailing list<br clear="none" class="" style="">
<a rel="nofollow" shape="rect" ymailto="mailto:Imports@openstreetmap.org" target="_blank" href="mailto:Imports@openstreetmap.org" class="" style="">Imports@openstreetmap.org</a><br clear="none" class="" style="">
<a rel="nofollow" shape="rect" target="_blank" href="https://lists.openstreetmap.org/listinfo/imports" class="" style="">https://lists.openstreetmap.org/listinfo/imports</a><br clear="none" class="" style="">
<br clear="none" class="" style=""></blockquote></div><br clear="none" class="" style=""></div></div></div><br clear="none" class="" style=""><div class="" style="">_______________________________________________<br clear="none" class="" style="">Imports mailing list<br clear="none" class="" style=""><a rel="nofollow" shape="rect" ymailto="mailto:Imports@openstreetmap.org" target="_blank" href="mailto:Imports@openstreetmap.org" class="" style="">Imports@openstreetmap.org</a><br clear="none" class="" style="">
<a rel="nofollow" shape="rect" target="_blank" href="https://lists.openstreetmap.org/listinfo/imports" class="" style="">https://lists.openstreetmap.org/listinfo/imports</a><br clear="none" class="" style=""></div><br clear="none" class="" style=""><br clear="none" class="" style=""></div><span class="" style=""><font color="#888888" class="" style=""> </font></span></blockquote>
<span class="" style=""><font color="#888888" class="" style=""> </font></span></div><span class="" style=""><font color="#888888" class="" style=""> </font></span></div><span class="" style=""><font color="#888888" class="" style=""> </font></span></div><span class="" style=""><font color="#888888" class="" style=""> </font></span></div>
</div><span class="" style=""><font color="#888888" class="" style="">
</font></span>
-- <br clear="none" class="" style="">
You received this message because you are subscribed to the Google Groups "mappingdc" group.<br clear="none" class="" style="">
To unsubscribe from this group and stop receiving emails from it, send an email to <a rel="nofollow" shape="rect" ymailto="mailto:mappingdc+unsubscribe@googlegroups.com" target="_blank" href="mailto:mappingdc+unsubscribe@googlegroups.com" class="" style="">mappingdc+unsubscribe@googlegroups.com</a>.<br clear="none" class="" style="">
To post to this group, send email to <a rel="nofollow" shape="rect" ymailto="mailto:mappingdc@googlegroups.com" target="_blank" href="mailto:mappingdc@googlegroups.com" class="" style="">mappingdc@googlegroups.com</a>.<br clear="none" class="" style="">
Visit this group at <a rel="nofollow" shape="rect" target="_blank" href="http://groups.google.com/group/mappingdc" class="" style="">http://groups.google.com/group/mappingdc</a>.<br clear="none" class="" style="">
For more options, visit <a rel="nofollow" shape="rect" target="_blank" href="https://groups.google.com/d/optout" class="" style="">https://groups.google.com/d/optout</a>.<br clear="none" class="" style="">
</blockquote></div><br clear="none" class="" style=""></div></div></div></div></div><br class="" style=""><div class="" id="yqt55673" style="">_______________________________________________<br clear="none" class="" style="">Imports mailing list<br clear="none" class="" style=""><a shape="rect" ymailto="mailto:Imports@openstreetmap.org" href="mailto:Imports@openstreetmap.org" class="" style="">Imports@openstreetmap.org</a><br clear="none" class="" style=""><a shape="rect" href="https://lists.openstreetmap.org/listinfo/imports" target="_blank" class="" style="">https://lists.openstreetmap.org/listinfo/imports</a><br clear="none" class="" style=""></div><br class="" style=""><br class="" style=""></div> </blockquote> </div> </div> </div> </div></body></html>