<div dir="ltr">I'll keep an eye out for places where it's right to deconflate, and for opportunities to tag CDP's correctly. I'm starting with the areas of the state where the original import failed altogether, and Long Island is likely to come last.<br><br>A lot of the CDP's on Long Island are legal Hamlets with signed and defined borders, despite having no home rule, so 'correct' tagging is controversial. I don't have a good data source for Hamlets - they're designated (when they are) by individual Towns.</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Dec 15, 2021 at 4:15 PM Brian M. Sperlongano <<a href="mailto:zelonewolf@gmail.com">zelonewolf@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">As a data consumer of boundaries, this is sorely needed, and thanks and sympathies for taking it on. Will this clear up the mess of improperly tagged CDPs from the original import as well as all of the admin_level=8 boundaries (many of which are mis-tagged CDPs)? Long Island seems to have the worst of it, and everything is glued to streets, making them exceptionally prone to breakage.</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Dec 15, 2021 at 1:33 AM Kevin Kenny <<a href="mailto:kevin.b.kenny@gmail.com" target="_blank">kevin.b.kenny@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><br></div>The OSM representation of minor civil divisions in New York State has several problems.<div><br></div><div>(1) About a third of the cities, towns and villages, most of them in the northern and western parts of the state, are missing entirely - apparently the TIGER and USGS imports never succeeded in importing them.</div><div><br></div><div>(2) Many administrative boundaries in TIGER were simply incorrect. The state's database appears to be more trustworthy; for example, there was reasonable alignment between the state's data and the county's tax rolls in the case described in <a href="https://www.openstreetmap.org/user/ke9tv/diary/391486" target="_blank">https://www.openstreetmap.org/user/ke9tv/diary/391486</a>.</div><div><br></div><div>(3) Few, if any, of the minor civil subdivisions' populations have been updated as of the 2020 census.</div><div><br></div><div>(4) Some boundaries were conflated with watercourses that have changed course abruptly in Hurricanes Irene (2011), Lee (2011) and Sandy (2012). Because these changes were avulsion (abrupt change resulting from a specific catastrophe) rather than accretion (gradual deposition of sediment), erosion, or reliction (exposure of land by declining water level), they often did not move the boundaries, even though the watercourses have since been edited. These moved watercourses must be deconflated with the boundaries, and the boundaries returned to their proper places. </div><div><br></div><div>New York State maintains authoritative data sets for minor civil divisions at <a href="http://gis.ny.gov/civil-boundaries/" target="_blank">http://gis.ny.gov/civil-boundaries/</a>. The license for these data is the state's standard open data license, available from <a href="https://data.ny.gov/dataset/OPEN-NY-Terms-Of-Use/77gx-ii52" target="_blank">https://data.ny.gov/dataset/OPEN-NY-Terms-Of-Use/77gx-ii52</a>. This license governs several New York data products that have already been imported; most notably the Department of Environmental Conservation lands and campgrounds, the state parks and state historic sites, and the statewide address point data.</div><div><br></div><div>Starting from the shapefiles available from <a href="http://gis.ny.gov" target="_blank">gis.ny.gov</a>, I've succeeded in making a topologically-correct OSM data set. It's available for inspection at <a href="https://kbk.is-a-geek.net/attachments/20211215/topo_cities_towns.osm.pbf" target="_blank">https://kbk.is-a-geek.net/attachments/20211215/topo_cities_towns.osm.pbf</a></div><div><br></div><div>The tag, 'user:ke9tv:fid' present on the ways is there because the conflation process that I'm using needs to know, for the ways that are already done, what the unique ID of the way was in the source database. It will be removed from OSM at the conclusion of the import. The other odd tags are</div><div><br></div><div>gnis:feature_id - Same meaning as in TIGER: the GNIS ID of the feature in question; a foreign key into many government databases.</div><div>nist:fips_code - The FIPS code of the feature in question; another important foreign key that ties together government databases.</div><div>us:ny:swis - The code for the feature in New York's Statewide Information System, again a foreign key into many external databases.</div><div><br></div><div><div><br></div><div>The idea with this file is that I'll go through it, town by town. (There are 1600 towns; I should be able to stitch things together in a few weeks.) The workflow will be to copy-and-paste the relations for the municipalities into JOSM one at a time, do manual conflation of the borders, do manual conflation of the relations, update populations, add Wikipedia and Wikidata tags, and upload. I've only done one township - Champlain, New York - so far, as a test case. It can be seen at <a href="https://www.openstreetmap.org/relation/13552232" target="_blank">https://www.openstreetmap.org/relation/13552232</a> . Note that the two member ways <a href="https://www.openstreetmap.org/way/1012328548" target="_blank">https://www.openstreetmap.org/way/1012328548</a> and <a href="https://www.openstreetmap.org/way/1012328549" target="_blank">https://www.openstreetmap.org/way/1012328549</a> are already split, to allow seamlessly anchoring the boundary between Chazy and Mooers, the next bordering towns. The villages of Champlain and Rouses Point are also done. The latter shares boundaries with the township, the county, the state and the United States.</div><div><br></div><div>If there are any serious problems with this project, I'm prepared to revert or amend the two changesets that have been committed so far. </div><div><br></div><div>Given the amount of manual work that's being done here, this hardly qualifies as a 'mechanical edit' - but given that the external data source is a specific file that we haven't used before, I thought it wise to run this by the community. Please let me know of any objections!</div>-- <br><div dir="ltr">73 de ke9tv/2, Kevin</div></div></div>
_______________________________________________<br>
Talk-us mailing list<br>
<a href="mailto:Talk-us@openstreetmap.org" target="_blank">Talk-us@openstreetmap.org</a><br>
<a href="https://lists.openstreetmap.org/listinfo/talk-us" rel="noreferrer" target="_blank">https://lists.openstreetmap.org/listinfo/talk-us</a><br>
</blockquote></div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature">73 de ke9tv/2, Kevin</div>