<div dir="auto">Brilliant then 👍<div dir="auto">I have zero negatives towards this in that case.</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, 3 Feb 2021, 22:24 Mateusz Konieczny via talk, <<a href="mailto:talk@openstreetmap.org">talk@openstreetmap.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div>It is definitely not removing all parameters just because one is tracking.<br></div><div><br>Most cases are left for manual review, so will not be handled by automatic edit,</div><div>but for example see <a href="https://www.openstreetmap.org/node/2887372516" target="_blank" rel="noreferrer">https://www.openstreetmap.org/node/2887372516</a> that has<br></div><div><br></div><div>website = <a href="https://www.hammer-zuhause.de/maerkte/storeDetail?utm_campaign=googlemaps&utm_medium=organic&storeCode=0214&utm_source=uberall&utm_content=06366_K%C3%B6then_(Anhalt)" target="_blank" rel="noreferrer">https://www.hammer-zuhause.de/maerkte/storeDetail?utm_campaign=googlemaps&utm_medium=organic&storeCode=0214&utm_source=uberall&utm_content=06366_K%C3%B6then_(Anhalt)</a><br></div><div><br></div><div>that will be turned to:<br></div><div><br></div><div>website = <a href="https://www.hammer-zuhause.de/maerkte/storeDetail?storeCode=0214" target="_blank" rel="noreferrer">https://www.hammer-zuhause.de/maerkte/storeDetail?storeCode=0214</a><br></div><div><br></div><div><br></div><div>Feb 3, 2021, 23:07 by <a href="mailto:oliversimmo@gmail.com" target="_blank" rel="noreferrer">oliversimmo@gmail.com</a>:<br></div><blockquote style="border-left:1px solid #93a3b8;padding-left:10px;margin-left:5px"><div dir="auto"><div dir="auto"><div>(sorry if you received this twice, forgot to do "reply to all" :/ )<br></div><div dir="auto"><br></div><div dir="auto"><div dir="auto">Just asking for clarification that this is only removing URL query sections recognised as tracking, and not the entire URL query.<br></div><div dir="auto">The query is often used for, well, a query for a dynamic page.<br></div><div dir="auto"><br></div><div dir="auto">e.g.<br></div><div dir="auto"><a href="https://www.example.com/search?tracking=yes&q=my%20search&tracking_id=12345" rel="noopener noreferrer noreferrer" target="_blank">https://www.example.com/search?tracking=yes&q=my%20search&tracking_id=12345</a><br></div><div dir="auto">Should become<br></div><div dir="auto"><a href="https://www.example.com/search?q=my%20search" rel="noopener noreferrer noreferrer" target="_blank">https://www.example.com/search?q=my%20search</a><br></div><div dir="auto">NOT<br></div><div dir="auto"><a href="https://www.example.com/search" rel="noopener noreferrer noreferrer" target="_blank">https://www.example.com/search</a><br></div><div dir="auto"><br></div></div></div><div><br></div><div><div dir="ltr">On Tue, 2 Feb 2021, 21:21 Mateusz Konieczny via talk, <<a rel="noopener noreferrer noreferrer" href="mailto:talk@openstreetmap.org" target="_blank">talk@openstreetmap.org</a>> wrote:<br></div><blockquote style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div>tl;dr:<br></div><div><br></div><div>I propose to run an automated bot edit that will remove tracking parameters, turning tags <br></div><div>such as<br></div><div>website=<a rel="noopener noreferrer noreferrer" href="http://paris.intersquat.org/les-lieux/le-satellite/?fbclid=de58e340d6aa79a584552a2055042d004b9b19454bc0d7a6046fc81fc90f51" target="_blank">http://paris.intersquat.org/les-lieux/le-satellite/?fbclid=de58e340d6aa79a584552a2055042d004b9b19454bc0d7a6046fc81fc90f51</a><br></div><div>into<br></div><div>website=<a rel="noopener noreferrer noreferrer" href="http://paris.intersquat.org/les-lieux/le-satellite/" target="_blank">http://paris.intersquat.org/les-lieux/le-satellite/</a><br></div><div><br></div><div><br></div><div>I did it already before, see: <a rel="noopener noreferrer noreferrer" href="https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account/remove_tracking_parameters" target="_blank">https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account/remove_tracking_parameters</a><br></div><div>This edit will remove newly edited links and purge more tracking parameters.<br></div><div><br></div><div>If anything will go wrong I will fix it.<br></div><div>I have experience with automated edits, see<br></div><div><a rel="noopener noreferrer noreferrer" href="https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account" target="_blank">https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account</a><br></div><div><br></div><div>changes listing: <a rel="noopener noreferrer noreferrer" href="https://gist.github.com/matkoniecz/1d20caa198ec2d4001d95adf09123a8a" target="_blank">https://gist.github.com/matkoniecz/1d20caa198ec2d4001d95adf09123a8a</a><br></div><div>(based on current OSM database, if OSM data changes then actual edit will be different,<br></div><div>feel free to make backup of this linked file - it may be deleted some time after edit)<br></div><div><br></div><div>source code and other documentation (except source code, duplicate of that posting):<br></div><div><a rel="noopener noreferrer noreferrer" href="https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account/remove_tracking_parameters2/" target="_blank">https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account/remove_tracking_parameters2/</a><br></div><div><br></div><div>--------------------------------------<br></div><div>full details:<br></div><div><br></div><div>I propose to run a scripted edit - it was already run before but this will<br></div><div>remove more tracking parameters.<br></div><div><br></div><div>URL often have unnecessary parts, some added for tracking purposes<br></div><div>by FB, Google and others.<br></div><div>This tracking parameters should never appear in any osm tags.<br></div><div><br></div><div>It means that it is beneficial to turn tag<br></div><div>website=<a rel="noopener noreferrer noreferrer" href="http://paris.intersquat.org/les-lieux/le-satellite/?fbclid=de58e340d6aa79a584552a2055042d004b9b19454bc0d7a6046fc81fc90f51" target="_blank">http://paris.intersquat.org/les-lieux/le-satellite/?fbclid=de58e340d6aa79a584552a2055042d004b9b19454bc0d7a6046fc81fc90f51</a><br></div><div>into<br></div><div>website=<a rel="noopener noreferrer noreferrer" href="http://paris.intersquat.org/les-lieux/le-satellite/" target="_blank">http://paris.intersquat.org/les-lieux/le-satellite/</a><br></div><div>and it is worth doing it as an edit.<br></div><div><br></div><div>This urls can be often fixed using an automated script, allowing to<br></div><div>use human time on something more productive.<br></div><div><br></div><div>Human-made edit will also result in changing "last edited by"<br></div><div>(while not allowing to filter out such edits unlike marked bot edit),<br></div><div>there are better ways to spot areas requiring fixes and we are not lacking<br></div><div>places with QA indicators that manual review is needed.<br></div><div><br></div><div>Usually tracking links are added by clueless people who just searched for<br></div><div>a website and copied it from FB/Google.<br></div><div><br></div><div>There are rare cases of links created to specifically track OSM users<br></div><div>see for example<br></div><div>* <a rel="noopener noreferrer noreferrer" href="https://www.openstreetmap.org/way/754704241/history" target="_blank">https://www.openstreetmap.org/way/754704241/history</a><br></div><div>** <a rel="noopener noreferrer noreferrer" href="https://www.cronauerlaw.com/?utm_source=openstreetmap" target="_blank">https://www.cronauerlaw.com/?utm_source=openstreetmap</a><br></div><div>* <a rel="noopener noreferrer noreferrer" href="https://www.openstreetmap.org/node/1063808111/history" target="_blank">https://www.openstreetmap.org/node/1063808111/history</a><br></div><div>** <a rel="noopener noreferrer noreferrer" href="http://www.travelerscoffee.ru?utm_campaign=geo&utm_source=openstreetmap&utm_medium=link" target="_blank">http://www.travelerscoffee.ru?utm_campaign=geo&utm_source=openstreetmap&utm_medium=link</a><br></div><div>* <a rel="noopener noreferrer noreferrer" href="https://www.openstreetmap.org/node/6817678019/history" target="_blank">https://www.openstreetmap.org/node/6817678019/history</a><br></div><div>** <a rel="noopener noreferrer noreferrer" href="https://www.resotainer.fr/agence-bonneuil-sur-marne?utm_source=open-street-map&utm_medium=recherche-locale&utm_content=openstreetmap&utm_campaign=open-street-map-garde-meubles-bonneuil-sur-marne" target="_blank">https://www.resotainer.fr/agence-bonneuil-sur-marne?utm_source=open-street-map&utm_medium=recherche-locale&utm_content=openstreetmap&utm_campaign=open-street-map-garde-meubles-bonneuil-sur-marne</a><br></div><div>* <a rel="noopener noreferrer noreferrer" href="https://www.openstreetmap.org/node/1684317522" target="_blank">https://www.openstreetmap.org/node/1684317522</a><br></div><div>** <a rel="noopener noreferrer noreferrer" href="http://www.travelerscoffee.ru?utm_campaign=geo&utm_source=openstreetmap&utm_medium=link" target="_blank">http://www.travelerscoffee.ru?utm_campaign=geo&utm_source=openstreetmap&utm_medium=link</a><br></div><div><br></div><div>In general I have not noticed correlation between presence of tracking links<br></div><div>and additional issues that would not be detected automatically.<br></div><div><br></div><div>Therefore automatic removal of tracking parameters is not causing loss of<br></div><div>useful indicators of areas that should be reviewed.<br></div><div>Osmose and JOSM validators and StreetComplete are offering many better indicators,<br></div><div>and we are not in danger of running out of places where human intervention is clearly needed.<br></div><div><br></div><div>Automatic removal would allow me and others to spend time on something more useful,<br></div><div>than reviewing all cases where tracking is clearly present and confirming them one by one.<br></div><div><br></div><div>Proposed bot edit would remove links where all used parameters are tracking<br></div><div>users and may be removed.<br></div><div><br></div><div>I am reviewing manually more complicated cases to catch<br></div><div>also currently unknown tracking parameters.<br></div><div><br></div><div>Anchors (#section) will be preserved.<br></div><div><br></div><div>Code is tested, was using it in a manual review mode and for a fully automated edit run<br></div><div>that removed tracking parameters from over 1000 objects - see<br></div><div><a rel="noopener noreferrer noreferrer" href="https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account/remove_tracking_parameters" target="_blank">https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account/remove_tracking_parameters</a><br></div><div><br></div><div>I have experience with automated edits, see<br></div><div><a rel="noopener noreferrer noreferrer" href="https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account" target="_blank">https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account</a><br></div><div><br></div><div>Yes, editing element will cause it to be edited and change "last edited" date.<br></div><div>Effect will be exactly the same in case of using bot and manual edit<br></div><div>(which would be necessary in case of rejecting this automated edit proposal).<br></div><div>Note that in case of bot edits you may filter out bot edits marked as automatic.<br></div><div><br></div><div>following are consider as tracking parameters and would be removed:<br></div><div><br></div><div>fbclid, gclid, campaign_ref, mc_id, utm_source, utm_medium, utm_term,<br></div><div>utm_content, utm_campaign, utm_id, gclsrc, dclid, wt.tsrc, WT.tsrc,<br></div><div>zanpid, yclid, utm_campain, trkCampaign, mkt_tok, sc_campaign, sc_channel,<br></div><div>sc_content, sc_medium, sc_outcome, sc_geo, sc_country, mbid, cmpid,<br></div><div>campaign_id, Campaign, fb_action_ids, fb_action_types, fb_ref, fb_source,<br></div><div>gs_l, _hsenc, igshid, CampIDMin, CampIDMaj, campaign, Campaign,<br></div><div>campaignid, campaignId, adid, adgroupid, refr, referrer, cm_mmc, lw_cmp,<br></div><div>CLID, ReferralSource, SourceID, trkid, adjust_creative, partner_slug, y_source,<br></div><div>oppartnerid, padid, otppartnerid, ref_device_id, utm_kxconfid, SEO_id,<br></div><div>originalReferrer, spMailingID, hsCtaTracking<br></div></div><div>_______________________________________________<br></div><div> talk mailing list<br></div><div> <a rel="noopener noreferrer noreferrer" href="mailto:talk@openstreetmap.org" target="_blank">talk@openstreetmap.org</a><br></div><div> <a rel="noopener noreferrer noreferrer" href="https://lists.openstreetmap.org/listinfo/talk" target="_blank">https://lists.openstreetmap.org/listinfo/talk</a><br></div></blockquote></div></div></blockquote><div><br></div> </div>
_______________________________________________<br>
talk mailing list<br>
<a href="mailto:talk@openstreetmap.org" target="_blank" rel="noreferrer">talk@openstreetmap.org</a><br>
<a href="https://lists.openstreetmap.org/listinfo/talk" rel="noreferrer noreferrer" target="_blank">https://lists.openstreetmap.org/listinfo/talk</a><br>
</blockquote></div>