<div dir="ltr"><div class="gmail_extra">Thanks, David and Mikel. After digging through the github repo, I was able to find the information I was looking for in the makefile and corresponding commit comment[1]. Apparently, the decision was made not to use the full DC buildings dataset but a partial dataset produced by OCTO. So I suppose the reasoning was that it was worth sacrificing having a complete DC address database in order to avoid re-importing a bunch of footprints that already exist.</div>
<div class="gmail_extra"><br></div><div class="gmail_extra">I'm fairly new to community. I think better documentation on the wiki and even github would have been in order, since much of these decisions appeared to have been been made offline. Anyone jumping in now should be able to easily follow the details of the plan, including why choices were made, without digging through the code or commit messages.</div>
<div class="gmail_extra"><br></div><div class="gmail_extra">This may be what someone else was concerned about when they mentioned reservations about an import being conducted primarily by a local government. It's great that OCTO have taken the initiative, but their priorities and concerns would naturally not exactly be in alignment with those of the OSM community.</div>
<div class="gmail_extra"><br></div><div class="gmail_extra">With that being said, I applaud all of the hard work that has been done to make this happen.</div><div class="gmail_extra"><br></div><div class="gmail_extra">-Brandon</div>
<div class="gmail_extra"><br></div><div class="gmail_extra">[1] <a href="https://github.com/osmlab/dcbuildings/commit/117b1a7636eb04d70e7876eac88eabf6f9b60fc2">https://github.com/osmlab/dcbuildings/commit/117b1a7636eb04d70e7876eac88eabf6f9b60fc2</a><br>
</div><div class="gmail_extra">
<br><div class="gmail_quote">On Thu, Aug 7, 2014 at 9:22 AM, Mikel Maron <span dir="ltr"><<a href="mailto:mikel.maron@gmail.com" target="_blank">mikel.maron@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div><div style="color:rgb(0,0,0);font-family:HelveticaNeue,'Helvetica Neue',Helvetica,Arial,'Lucida Grande',sans-serif;font-size:10pt;background-color:rgb(255,255,255)"><div><span>> </span><font face="arial, sans-serif" style="font-size:12.727272033691406px">"</font><span style="font-size:13px;font-family:arial,sans-serif">Will this be taken care of in a separate process that I am unaware of?" No plans for that at this time. </span></div>
<div><span style="font-size:13px;font-family:arial,sans-serif"><br></span></div><div></div><div>But we (DC OSM community) can start thinking about it. Was decided that this after this first "easy" import pass, would look at this harder conflation import later.</div>
<div> </div><div>* Mikel Maron * <a href="tel:%2B14152835207" value="+14152835207" target="_blank">+14152835207</a> @mikel
s:mikelmaron</div> <div><br><br></div><div style="display:block"> <div style="font-family:HelveticaNeue,'Helvetica Neue',Helvetica,Arial,'Lucida Grande',sans-serif;font-size:10pt"> <div style="font-family:HelveticaNeue,'Helvetica Neue',Helvetica,Arial,'Lucida Grande',sans-serif;font-size:12pt">
<div dir="ltr"> <font face="Arial"> On Thursday, August 7, 2014 8:19 AM, David Jackson (OCTO) <<a href="mailto:davidy.jackson@dc.gov" target="_blank">davidy.jackson@dc.gov</a>> wrote:<br> </font> </div> <blockquote style="border-left-width:2px;border-left-style:solid;border-left-color:rgb(16,16,255);margin-left:5px;margin-top:5px;padding-left:5px">
<br><br> <div><div><div><div dir="ltr">Brandon,<div><br clear="none"></div><div>To answer your solid questions.</div><div><br clear="none"></div><div>1) "<font style="font-size:13px;font-family:arial,sans-serif"> </font><span style="font-size:13px;font-family:arial,sans-serif">Are these chunks empty because there was found to be no difference from what already existed in OSM from previous imports?</span><span style="font-size:13px;font-family:arial,sans-serif"> "</span></div>
<div><span style="font-size:13px;font-family:arial,sans-serif"><br clear="none"></span></div><div><span style="font-size:13px;font-family:arial,sans-serif">No. There are many differences between existing building / address data in OSM and what is being loaded. Examples included have buildings tagged with addresses, geometry of data among others.</span></div>
<div><span style="font-size:13px;font-family:arial,sans-serif"><br clear="none"></span></div><div><span style="font-size:13px;font-family:arial,sans-serif">2) "</span><span style="font-family:arial,sans-serif;font-size:13px">Why was the decision made to use the tasking manager to conduct a partial import as opposed to conflating the entire dataset, given that the new import process is adding not only building footprints but footprints+addresses? "</span></div>
<div><span style="font-family:arial,sans-serif;font-size:13px"><br clear="none"></span></div><div><span style="font-family:arial,sans-serif;font-size:13px">The goal of the project was to 'complete' or fill in (almost 100%) the buildings (with address where they exist) for the rest of DC. This means over 50,000 buildings. The decision was made because to do a partial import because it would be much less time intensive.</span></div>
<div><span style="font-family:arial,sans-serif;font-size:13px"><br clear="none"></span></div><div><font face="arial, sans-serif">"</font><span style="font-family:arial,sans-serif;font-size:13px">Will this be taken care of in a separate process that I am unaware of?" No plans for that at this time. </span></div>
<div><span style="font-family:arial,sans-serif;font-size:13px"><br clear="none"></span></div><div><span style="font-family:arial,sans-serif;font-size:13px">- David</span></div><div><span style="font-size:13px;font-family:arial,sans-serif"><br clear="none">
</span></div></div><div><br clear="all"><div><div dir="ltr"><div>David Jackson | GIS Analyst | Office of the Chief technology Officer<br clear="none"></div>
<div></div>
<div>(W) <a href="tel:202.724.5135" value="+12027245135" target="_blank">202.724.5135</a> | 200 I ST SE, 5TH FL, Washington, DC <br clear="none"></div><a rel="nofollow" shape="rect" href="mailto:davidy.jackson@dc.gov" target="_blank">davidy.jackson@dc.gov</a> | Blog: <a rel="nofollow" shape="rect" href="http://dcaddresscoordinates.blogspot.com/" target="_blank">dcaddresscoordinates.blogspot.com</a><br clear="none">
<div><div>Telework Day: Fri<br clear="none"></div></div></div></div>
<br clear="none"><br clear="none"><div>On Wed, Aug 6, 2014 at 4:44 PM, Brandon Knight <span dir="ltr"><<a rel="nofollow" shape="rect" href="mailto:bknight430@gmail.com" target="_blank">bknight430@gmail.com</a>></span> wrote:<br clear="none">
<blockquote style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div><div dir="ltr"><div>Posting this to the OSM Imports and the MappingDC lists:</div><div><br clear="none"></div>I've been reviewing the work by OCTO on DC building/address imports currently being conducted via the tasking manager[1] and I've noticed a few things that raised some questions about this plan. Excuse me if I don't understand this or if there are obvious answers to these questions. I'm new here.<div>
<br clear="none"></div><div>From my understanding, the current plan is to import all DC buildings and addresses in areas that were not imported in 2008-10. Tags were converted, building shapes simplified, and then the tags from MAR points[2] were joined to building footprints[3] when a building was found to contain only one address point, and the point deleted. Data was then split up into chunks by block group and converted to .osm files. Scripts found in the dcbuildings repo[4]</div>
<div><br clear="none"></div><div>After loading some of block group chunks using the tasking manager I've found that many are completely empty (0 nodes). The explanation I was given by OCTO was:</div><div><br clear="none">
</div><div>"<span style="font-family:arial,sans-serif;font-size:13px"> </span><span style="font-family:arial,sans-serif;font-size:13px">Many of the chunks created by mapbox did not contain any data, this is due to the fact that these areas already had complete or near complete building / addresses in OSM for that area."</span></div>
<div><br clear="none"></div><div><span style="font-family:arial,sans-serif"><br clear="none"></span></div><div><span style="font-family:arial,sans-serif">My questions are:</span></div><div><br clear="none"></div><div><font face="arial, sans-serif">1) </font><span style="font-family:arial,sans-serif">Are these chunks empty because there was found to be no difference from what already existed in OSM from previous imports?</span><span style="font-family:arial,sans-serif"> </span></div>
<div><span style="font-family:arial,sans-serif"><br clear="none"></span></div><div><span style="font-family:arial,sans-serif">I originally thought that the entire DC dataset would be represented in these chunks. If chunks containing only "diffs" was the plan, I couldn't find a clear description of this or representation in the code.</span></div>
<div><font face="arial, sans-serif"><br clear="none"></font></div><div><font face="arial, sans-serif">2) Why was the decision made to use the tasking manager to conduct a partial import as opposed to conflating the entire dataset, given that the new import process is adding not only building footprints but footprints+addresses? </font></div>
<div><font face="arial, sans-serif"><br clear="none"></font></div><div><font face="arial, sans-serif">I found examples of large areas of block groups with previously imported buildings lacking addresses that corresponded to empty chunk files. I looked at the raw data and these should contain buildings with joined address tags that could be copied to the existing buildings. Currently there are large swaths of buildings with no addresses. Will this be taken care of in a separate process that I am unaware of?</font></div>
<div><font face="arial, sans-serif"><br clear="none"></font></div><div><font face="arial, sans-serif">I also found previously imported buildings that does not exist in the current dataset (or in any satellite imagery that I could find). Since this import is semi-automated, wouldn't a comparison of the full dataset allowed for someone to spot this and remove it?</font></div>
<div><font face="arial, sans-serif"><br clear="none"></font></div><div><font face="arial, sans-serif">Thanks,</font></div><div><font face="arial, sans-serif"><br clear="none"></font></div><div><font face="arial, sans-serif">-Brandon</font></div>
<div>
<span style="font-family:arial,sans-serif">@geobrando</span><br clear="none"></div><div><font face="arial, sans-serif"><br clear="none"></font></div><div><div>[1]<a rel="nofollow" shape="rect" href="http://tasks.openstreetmap.us/job/6" target="_blank">http://tasks.openstreetmap.us/job/6</a></div>
</div><div>[2]<a rel="nofollow" shape="rect" href="http://data.dc.gov/Metadata.aspx?id=190" target="_blank">http://data.dc.gov/Metadata.aspx?id=190</a></div><div>[3]<a rel="nofollow" shape="rect" href="http://data.dc.gov/Metadata.aspx?id=59" target="_blank">http://data.dc.gov/Metadata.aspx?id=59</a></div>
<div>
[4]<a rel="nofollow" shape="rect" href="https://github.com/osmlab/dcbuildings" target="_blank">https://github.com/osmlab/dcbuildings</a></div><div><br clear="none"></div></div></div>
<br clear="none">_______________________________________________<br clear="none">
Imports mailing list<br clear="none">
<a rel="nofollow" shape="rect" href="mailto:Imports@openstreetmap.org" target="_blank">Imports@openstreetmap.org</a><br clear="none">
<a rel="nofollow" shape="rect" href="https://lists.openstreetmap.org/listinfo/imports" target="_blank">https://lists.openstreetmap.org/listinfo/imports</a><br clear="none">
<br clear="none"></blockquote></div><br clear="none"></div></div></div><br><div>_______________________________________________<br clear="none">Imports mailing list<br clear="none"><a shape="rect" href="mailto:Imports@openstreetmap.org" target="_blank">Imports@openstreetmap.org</a><br clear="none">
<a shape="rect" href="https://lists.openstreetmap.org/listinfo/imports" target="_blank">https://lists.openstreetmap.org/listinfo/imports</a><br clear="none"></div><br><br></div><span><font color="#888888"> </font></span></blockquote>
<span><font color="#888888"> </font></span></div><span><font color="#888888"> </font></span></div><span><font color="#888888"> </font></span></div><span><font color="#888888"> </font></span></div>
</div><span><font color="#888888">
<p></p>
-- <br>
You received this message because you are subscribed to the Google Groups "mappingdc" group.<br>
To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:mappingdc+unsubscribe@googlegroups.com" target="_blank">mappingdc+unsubscribe@googlegroups.com</a>.<br>
To post to this group, send email to <a href="mailto:mappingdc@googlegroups.com" target="_blank">mappingdc@googlegroups.com</a>.<br>
Visit this group at <a href="http://groups.google.com/group/mappingdc" target="_blank">http://groups.google.com/group/mappingdc</a>.<br>
For more options, visit <a href="https://groups.google.com/d/optout" target="_blank">https://groups.google.com/d/optout</a>.<br>
</font></span></blockquote></div><br></div></div>