<div dir="ltr"><div>Ezek nagyon hasznos ellenőrzések. Látom, hogy ezek saját függvények. Esetleg be tudnánk vezetni valami hasonlót közismert QA eszközökben is?</div>https://github.com/KAMI911/osm_poi_matchmaker/commit/6d6a058500d6e6f90bf345879bb501f0e562d92e<div>https://wiki.openstreetmap.org/wiki/Quality_assurance<br><br>On Sunday, December 23, 2018 at 12:18:04 PM UTC+1, KAMI KAMI wrote:<blockquote class="gmail_quote" style="margin: 0;margin-left: 0.8ex;border-left: 1px #ccc solid;padding-left: 1ex;"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>Sziasztok, egyelőre a QC-ben bevezettem két ellenőrzést:</div><div><br></div><div> <!-- Checker good: {not_in_water,street_<wbr>metaphone_is_around,standard_<wbr>opening_hours}; bad {street_is_not_around}--><br></div><div><br></div><div>street_is_not_around - van/nincs olyan nevű utca az OSM-en a környéken, amely a POI addr:street mezőjében szerepel<br></div><div>street_metaphone_is_around - van/nincs olyan hangzású nevű utca az OSM-en a környéken, amely a POI addr:street mezőjében szerepel (kb az út-utca keveréseket tudja kiszűrni)</div><div><br></div><div>Egyelőre nincs ezeknek a teszten kivül semmi eredménye, de ha szerintetk hasznos és megbízható, esetleg be lehet vezetni, hogy a találatoknál legyen felülírva a POI addr:street adata.</div><div><br></div><div>Nagyjából ezek a lekérdezések állnak a háttérben:</div><div><br></div><div>Utcanév megtalálás a környéken, ha a név azonos (validátorhoz):<br>SELECT name, osm_id, highway, ST_Distance_Sphere(ST_<wbr>Transform(way, 4326), point.geom) as distance, way, ST_AsEWKT(way) as way_ewkt<br> FROM planet_osm_roads, (SELECT ST_SetSRID(ST_MakePoint(19.<wbr>03207,47.47248),4326) as geom) point<br> WHERE name = 'Bartók Béla út' AND highway is not NULL<br> AND ST_DWithin(ST_Buffer(way,3),<wbr>ST_Transform(point.geom,3857), 300)<br> ORDER BY distance ASC;<br><br>Utcanév megtalálás a környéken, ha a név azonos:<br>SELECT name, osm_id, highway, ST_Distance_Sphere(ST_<wbr>Transform(way, 4326), point.geom) as distance, way, ST_AsEWKT(way) as way_ewkt<br> FROM planet_osm_roads, (SELECT ST_SetSRID(ST_MakePoint(19.<wbr>03207,47.47248),4326) as geom) point<br> WHERE dmetaphone(name) = dmetaphone('Bartók Béla út') AND highway is not NULL<br> AND ST_DWithin(ST_Buffer(way,3),<wbr>ST_Transform(point.geom,3857), 300)<br> ORDER BY distance ASC;<br><br>Ugyanez, amikor út helyett utca van:<br>SELECT name, osm_id, highway, ST_Distance_Sphere(ST_<wbr>Transform(way, 4326), point.geom) as distance, way, ST_AsEWKT(way) as way_ewkt<br> FROM planet_osm_roads, (SELECT ST_SetSRID(ST_MakePoint(19.<wbr>03207,47.47248),4326) as geom) point<br> WHERE dmetaphone(name) = dmetaphone('Bartók Béla utca') AND highway is not NULL<br> AND ST_DWithin(ST_Buffer(way,3),<wbr>ST_Transform(point.geom,3857), 300)<br> ORDER BY distance ASC;<br><br>SELECT name, osm_id, highway, ST_Distance_Sphere(ST_<wbr>Transform(way, 4326), point.geom) as distance, way, ST_AsEWKT(way) as way_ewkt<br> FROM planet_osm_roads, (SELECT ST_SetSRID(ST_MakePoint(21.<wbr>07252,47.93337),4326) as geom) point<br> WHERE dmetaphone(name) = dmetaphone('Petőfi Sándor út') AND highway is not NULL<br> AND ST_DWithin(ST_Buffer(way,3),<wbr>ST_Transform(point.geom,3857), 300)<br> ORDER BY distance ASC;</div><div><br></div><div>Örömmel várom, ha van ötlet még ezen kívül, vagy bármi gondolat a témában.</div><div><br></div><div> <br></div><div><div><div><div dir="ltr"><div dir="ltr">Üdvözlettel / Best Regards:<br><br>Kálmán (KAMI) Szalai<br></div></div></div><br></div></div></div></div></div><br><div class="gmail_quote"><div dir="ltr">KAMI911 KAMI911 <<a href="javascript:" target="_blank" gdf-obfuscated-mailto="7_qygHecAQAJ" rel="nofollow" onmousedown="this.href='javascript:';return true;" onclick="this.href='javascript:';return true;">kam...@gmail.com</a>> ezt írta (időpont: 2018. dec. 20., Cs, 14:59):<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>Sziasztok,</div><div><br></div><div>Lehet elérkezett az idő hogy ez az egész import témát egybe kezeljük. Persze az importok külön-külön mennek, de a hibákat kereshetjük globálisan.</div><div><br></div><div>Ahogy átírtam a programot, sok-sok duplikátum megszűnt, ettől függetlenül érdemes lenne jobb adatokat megadni, hogy milyenek legyenek a keresési sugár értékek, safe (név és tag egyezés) és unsafe (csak tag egyezés) esetben. Szóval most sokkal jobbak a kilátások, de elkezdtem nézni a duplikátumokat és az AVIA-nál Martonvásárnál két poi is van egyik a település nevével, a másik Szabó Brigitta névvel. Jelezem nekik.</div><div>A Benunál a duplikálást az okozza, hogy két külön poi azonos GEOM-mal rendelkezik.<br></div><div><br></div><div>Van kedvetek a továbbiakat megfejteni, hogy mi a gond velük? És persze ha nem a mi hibánk akkor be is kellene jelenteni a cégeknek.<br></div><div><br></div><div>Természetesen az új elemekre is rá lehetne nézni, hogy biztos nem lesz valami duplikátum a működés révén.</div><div><br></div><div>Imrével már beszélgettük, hogyan lehetne szűrni az új és duplikált POI-kat mégvagy a megfelelő utcaelnevezéssel eltalálni, megadni, de akinek van valami ötlete, azt szívesen vesszük.</div><div><br></div><div>Frissített adatok:</div><div><a href="https://github.com/KAMI911/osm-import-request" target="_blank" rel="nofollow" onmousedown="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2FKAMI911%2Fosm-import-request\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGDEJ_QC2g7LAqHtJGYw1vKOWtVTg';return true;" onclick="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fgithub.com%2FKAMI911%2Fosm-import-request\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGDEJ_QC2g7LAqHtJGYw1vKOWtVTg';return true;">https://github.com/KAMI911/<wbr>osm-import-request</a></div><div><br></div><div>Most itt tartunk:</div><div><br></div><div>-----<br>300<br><br>./hu_avia/poi_address_merge_<wbr>huaviafu.osm<br> 2 <!-- OSM link: <a href="https://osm.org/node/320586750" target="_blank" rel="nofollow" onmousedown="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fnode%2F320586750\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFUJJXJvgbimYBY3BZtxXhyslKb1A';return true;" onclick="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fnode%2F320586750\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFUJJXJvgbimYBY3BZtxXhyslKb1A';return true;">https://osm.org/node/320586750</a> --><br>Duplicated elements: 1<br>New elements: 39<br><br>./hu_benu/poi_address_merge_<wbr>hubenupha.osm<br> 2 <!-- OSM link: <a href="https://osm.org/node/3520336469" target="_blank" rel="nofollow" onmousedown="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fnode%2F3520336469\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHrEVX09JPT0hswh_kCOkkuhKxgAA';return true;" onclick="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fnode%2F3520336469\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHrEVX09JPT0hswh_kCOkkuhKxgAA';return true;">https://osm.org/node/<wbr>3520336469</a> --><br>Duplicated elements: 1<br>New elements: 125<br><br>./hu_bp_bank/poi_address_<wbr>merge_hubpatm.osm<br>Duplicated elements: 0<br>New elements: 111<br><br>./hu_bp_bank/poi_address_<wbr>merge_hubpbank.osm<br>Duplicated elements: 0<br>New elements: 24<br><br>./hu_cba/poi_address_merge_<wbr>hucbacon.osm<br> 2 <!-- OSM link: <a href="https://osm.org/node/4251192415" target="_blank" rel="nofollow" onmousedown="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fnode%2F4251192415\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGJGxHrXr1HddMurQWMTz1CrIJD_w';return true;" onclick="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fnode%2F4251192415\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGJGxHrXr1HddMurQWMTz1CrIJD_w';return true;">https://osm.org/node/<wbr>4251192415</a> --><br>Duplicated elements: 1<br>New elements: 200<br><br>./hu_dm/poi_address_merge_<wbr>hudmche.osm<br>Duplicated elements: 0<br>New elements: 86<br><br>./hu_foxpost/poi_address_<wbr>merge_hufoxpocso.osm<br>Duplicated elements: 0<br>New elements: 98<br><br>./hu_kh/poi_address_merge_<wbr>hukhatm.osm<br>Duplicated elements: 0<br>New elements: 374<br><br>./hu_kh/poi_address_merge_<wbr>hukhbank.osm<br>Duplicated elements: 0<br>New elements: 73<br><br>./hu_kulcs/poi_address_merge_<wbr>hukulcspha.osm<br>Duplicated elements: 0<br>New elements: 63<br><br>./hu_mobil_petrol/poi_address_<wbr>merge_humobpefu.osm<br>Duplicated elements: 0<br>New elements: 2<br><br>./hu_mol/poi_address_merge_<wbr>humolfu.osm<br> 2 <!-- OSM link: <a href="https://osm.org/node/2302639399" target="_blank" rel="nofollow" onmousedown="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fnode%2F2302639399\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGilm0zoOzTTCTTu_nE1xs9iVqbtQ';return true;" onclick="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fnode%2F2302639399\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGilm0zoOzTTCTTu_nE1xs9iVqbtQ';return true;">https://osm.org/node/<wbr>2302639399</a> --><br> 2 <!-- OSM link: <a href="https://osm.org/way/434836133" target="_blank" rel="nofollow" onmousedown="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fway%2F434836133\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGSPNMZp2Lo9DGY8wixBIaRFvpf7g';return true;" onclick="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fway%2F434836133\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGSPNMZp2Lo9DGY8wixBIaRFvpf7g';return true;">https://osm.org/way/434836133</a> --><br>Duplicated elements: 2<br>New elements: 25<br><br>./hu_mol_bubi/poi_address_<wbr>merge_hububibir.osm<br>Duplicated elements: 0<br>New elements: 3<br><br>./hu_omv/poi_address_merge_<wbr>huomvfu.osm<br>Duplicated elements: 0<br>New elements: 16<br><br>./hu_posta/poi_address_merge_<wbr>hupostacse.osm<br>Duplicated elements: 0<br>New elements: 115<br><br>./hu_posta/poi_address_merge_<wbr>hupostacso.osm<br>Duplicated elements: 0<br>New elements: 50<br><br>./hu_posta/poi_address_merge_<wbr>hupostapo.osm<br>Duplicated elements: 0<br>New elements: 1233<br><br>./hu_posta/poi_address_merge_<wbr>hupostapp.osm<br> 2 <!-- OSM link: <a href="https://osm.org/node/3469960863" target="_blank" rel="nofollow" onmousedown="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fnode%2F3469960863\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFTaojkzWgx0CT9HfBi7a3TWaRp7g';return true;" onclick="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fnode%2F3469960863\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNFTaojkzWgx0CT9HfBi7a3TWaRp7g';return true;">https://osm.org/node/<wbr>3469960863</a> --><br>Duplicated elements: 1<br>New elements: 450<br><br>./hu_prima/poi_address_merge_<wbr>huprimacon.osm<br>Duplicated elements: 0<br>New elements: 36<br><br>./hu_rossmann/poi_address_<wbr>merge_hurossmche.osm<br>Duplicated elements: 0<br>New elements: 76<br><br>./hu_shell/poi_address_merge_<wbr>hushellfu.osm<br>Duplicated elements: 0<br>New elements: 3<br><br>./hu_spar/poi_address_merge_<wbr>husparexp.osm<br>Duplicated elements: 0<br>New elements: 61<br><br>./hu_spar/poi_address_merge_<wbr>husparint.osm<br>Duplicated elements: 0<br>New elements: 16<br><br>./hu_spar/poi_address_merge_<wbr>husparsup.osm<br> 2 <!-- OSM link: <a href="https://osm.org/node/1243005712" target="_blank" rel="nofollow" onmousedown="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fnode%2F1243005712\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHVI01P2fjUtI0yExrk-od_W963EQ';return true;" onclick="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fnode%2F1243005712\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNHVI01P2fjUtI0yExrk-od_W963EQ';return true;">https://osm.org/node/<wbr>1243005712</a> --><br> 2 <!-- OSM link: <a href="https://osm.org/way/228874975" target="_blank" rel="nofollow" onmousedown="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fway%2F228874975\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGM8CHt_5snfKJjkv2aJiAoT7-wHQ';return true;" onclick="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fway%2F228874975\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNGM8CHt_5snfKJjkv2aJiAoT7-wHQ';return true;">https://osm.org/way/228874975</a> --><br> 2 <!-- OSM link: <a href="https://osm.org/way/420910894" target="_blank" rel="nofollow" onmousedown="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fway%2F420910894\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEJatz-_CDuv8jylDoM7R17C0Ayug';return true;" onclick="this.href='https://www.google.com/url?q\x3dhttps%3A%2F%2Fosm.org%2Fway%2F420910894\x26sa\x3dD\x26sntz\x3d1\x26usg\x3dAFQjCNEJatz-_CDuv8jylDoM7R17C0Ayug';return true;">https://osm.org/way/420910894</a> --><br>Duplicated elements: 3<br>New elements: 150<br><br>./hu_tesco/poi_address_merge_<wbr>hutescoexp.osm<br>Duplicated elements: 0<br>New elements: 2<br><br>./hu_tesco/poi_address_merge_<wbr>hutescoext.osm<br>Duplicated elements: 0<br>New elements: 0<br><br>./hu_tesco/poi_address_merge_<wbr>husmrktexp.osm<br>Duplicated elements: 0<br>New elements: 2<br><br>./hu_tesco/poi_address_merge_<wbr>hutescosup.osm<br>Duplicated elements: 0<br>New elements: 2</div><div><br></div><div><div><div dir="ltr"><div dir="ltr">Üdvözlettel / Best Regards:<br><br>Kálmán (KAMI) Szalai<br></div></div></div></div></div></div></div></div>
</blockquote></div>
</blockquote></div></div>