<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
</head>
<body>
<div>No, as documented in the title it will remove solely tracking parameters,<br></div><div><br></div><div>Is there a substantial use of shortener links in tags that should be expanded<br></div><div>rather than removed?<br></div><div>Larger than say 200 links where manual processing is definitely<br></div><div>faster than implementing bot?<br></div><div><br></div><div>If yes - which ones?<br></div><div><br></div><div><br></div><div>Feb 4, 2021, 07:37 by e.marascalchi@gmail.com:<br></div><blockquote class="tutanota_quote" style="border-left: 1px solid #93A3B8; padding-left: 10px; margin-left: 5px;"><div dir="auto">Will this take care of link shortner (<a href="http://bit.ly" rel="noopener noreferrer" target="_blank">bit.ly</a> goog.le ...) As well expanding the links and replacing it with the correct one?<br></div><div><br></div><div class=""><div class="" dir="ltr">Il gio 4 feb 2021, 1:03 AM Oliver Simmons <<a href="mailto:oliversimmo@gmail.com" rel="noopener noreferrer" target="_blank">oliversimmo@gmail.com</a>> ha scritto:<br></div><blockquote style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex" class=""><div dir="auto"><div>Brilliant then 👍<br></div><div dir="auto">I have zero negatives towards this in that case.<br></div></div><div><br></div><div class=""><div class="" dir="ltr">On Wed, 3 Feb 2021, 22:24 Mateusz Konieczny via talk, <<a rel="noopener noreferrer" target="_blank" href="mailto:talk@openstreetmap.org">talk@openstreetmap.org</a>> wrote:<br></div><blockquote style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex" class=""><div><div>It is definitely not removing all parameters just because one is tracking.<br></div><div><div><br></div><div>Most cases are left for manual review, so will not be handled by automatic edit,<br></div></div><div>but for example see <a target="_blank" rel="noopener noreferrer" href="https://www.openstreetmap.org/node/2887372516">https://www.openstreetmap.org/node/2887372516</a> that has<br></div><div><br></div><div>website = <a target="_blank" rel="noopener noreferrer" href="https://www.hammer-zuhause.de/maerkte/storeDetail?utm_campaign=googlemaps&utm_medium=organic&storeCode=0214&utm_source=uberall&utm_content=06366_K%C3%B6then_(Anhalt)">https://www.hammer-zuhause.de/maerkte/storeDetail?utm_campaign=googlemaps&utm_medium=organic&storeCode=0214&utm_source=uberall&utm_content=06366_K%C3%B6then_(Anhalt)</a><br></div><div><br></div><div>that will be turned to:<br></div><div><br></div><div>website = <a target="_blank" rel="noopener noreferrer" href="https://www.hammer-zuhause.de/maerkte/storeDetail?storeCode=0214">https://www.hammer-zuhause.de/maerkte/storeDetail?storeCode=0214</a><br></div><div><br></div><div><br></div><div>Feb 3, 2021, 23:07 by <a target="_blank" rel="noopener noreferrer" href="mailto:oliversimmo@gmail.com">oliversimmo@gmail.com</a>:<br></div><blockquote style="border-left:1px solid #93a3b8;padding-left:10px;margin-left:5px"><div dir="auto"><div dir="auto"><div>(sorry if you received this twice, forgot to do "reply to all" :/ )<br></div><div dir="auto"><br></div><div dir="auto"><div dir="auto">Just asking for clarification that this is only removing URL query sections recognised as tracking, and not the entire URL query.<br></div><div dir="auto">The query is often used for, well, a query for a dynamic page.<br></div><div dir="auto"><br></div><div dir="auto">e.g.<br></div><div dir="auto"><a target="_blank" rel="noopener noreferrer" href="https://www.example.com/search?tracking=yes&q=my%20search&tracking_id=12345">https://www.example.com/search?tracking=yes&q=my%20search&tracking_id=12345</a><br></div><div dir="auto">Should become<br></div><div dir="auto"><a target="_blank" rel="noopener noreferrer" href="https://www.example.com/search?q=my%20search">https://www.example.com/search?q=my%20search</a><br></div><div dir="auto">NOT<br></div><div dir="auto"><a target="_blank" rel="noopener noreferrer" href="https://www.example.com/search">https://www.example.com/search</a><br></div><div dir="auto"><br></div></div></div><div><br></div><div><div dir="ltr">On Tue, 2 Feb 2021, 21:21 Mateusz Konieczny via talk, <<a target="_blank" href="mailto:talk@openstreetmap.org" rel="noopener noreferrer">talk@openstreetmap.org</a>> wrote:<br></div><blockquote style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div>tl;dr:<br></div><div><br></div><div>I propose to run an automated bot edit that will remove tracking parameters, turning tags <br></div><div>such as<br></div><div>website=<a target="_blank" href="http://paris.intersquat.org/les-lieux/le-satellite/?fbclid=de58e340d6aa79a584552a2055042d004b9b19454bc0d7a6046fc81fc90f51" rel="noopener noreferrer">http://paris.intersquat.org/les-lieux/le-satellite/?fbclid=de58e340d6aa79a584552a2055042d004b9b19454bc0d7a6046fc81fc90f51</a><br></div><div>into<br></div><div>website=<a target="_blank" href="http://paris.intersquat.org/les-lieux/le-satellite/" rel="noopener noreferrer">http://paris.intersquat.org/les-lieux/le-satellite/</a><br></div><div><br></div><div><br></div><div>I did it already before, see: <a target="_blank" href="https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account/remove_tracking_parameters" rel="noopener noreferrer">https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account/remove_tracking_parameters</a><br></div><div>This edit will remove newly edited links and purge more tracking parameters.<br></div><div><br></div><div>If anything will go wrong I will fix it.<br></div><div>I have experience with automated edits, see<br></div><div><a target="_blank" href="https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account" rel="noopener noreferrer">https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account</a><br></div><div><br></div><div>changes listing: <a target="_blank" href="https://gist.github.com/matkoniecz/1d20caa198ec2d4001d95adf09123a8a" rel="noopener noreferrer">https://gist.github.com/matkoniecz/1d20caa198ec2d4001d95adf09123a8a</a><br></div><div>(based on current OSM database, if OSM data changes then actual edit will be different,<br></div><div>feel free to make backup of this linked file - it may be deleted some time after edit)<br></div><div><br></div><div>source code and other documentation (except source code, duplicate of that posting):<br></div><div><a target="_blank" href="https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account/remove_tracking_parameters2/" rel="noopener noreferrer">https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account/remove_tracking_parameters2/</a><br></div><div><br></div><div>--------------------------------------<br></div><div>full details:<br></div><div><br></div><div>I propose to run a scripted edit - it was already run before but this will<br></div><div>remove more tracking parameters.<br></div><div><br></div><div>URL often have unnecessary parts, some added for tracking purposes<br></div><div>by FB, Google and others.<br></div><div>This tracking parameters should never appear in any osm tags.<br></div><div><br></div><div>It means that it is beneficial to turn tag<br></div><div>website=<a target="_blank" href="http://paris.intersquat.org/les-lieux/le-satellite/?fbclid=de58e340d6aa79a584552a2055042d004b9b19454bc0d7a6046fc81fc90f51" rel="noopener noreferrer">http://paris.intersquat.org/les-lieux/le-satellite/?fbclid=de58e340d6aa79a584552a2055042d004b9b19454bc0d7a6046fc81fc90f51</a><br></div><div>into<br></div><div>website=<a target="_blank" href="http://paris.intersquat.org/les-lieux/le-satellite/" rel="noopener noreferrer">http://paris.intersquat.org/les-lieux/le-satellite/</a><br></div><div>and it is worth doing it as an edit.<br></div><div><br></div><div>This urls can be often fixed using an automated script, allowing to<br></div><div>use human time on something more productive.<br></div><div><br></div><div>Human-made edit will also result in changing "last edited by"<br></div><div>(while not allowing to filter out such edits unlike marked bot edit),<br></div><div>there are better ways to spot areas requiring fixes and we are not lacking<br></div><div>places with QA indicators that manual review is needed.<br></div><div><br></div><div>Usually tracking links are added by clueless people who just searched for<br></div><div>a website and copied it from FB/Google.<br></div><div><br></div><div>There are rare cases of links created to specifically track OSM users<br></div><div>see for example<br></div><div>* <a target="_blank" href="https://www.openstreetmap.org/way/754704241/history" rel="noopener noreferrer">https://www.openstreetmap.org/way/754704241/history</a><br></div><div>** <a target="_blank" href="https://www.cronauerlaw.com/?utm_source=openstreetmap" rel="noopener noreferrer">https://www.cronauerlaw.com/?utm_source=openstreetmap</a><br></div><div>* <a target="_blank" href="https://www.openstreetmap.org/node/1063808111/history" rel="noopener noreferrer">https://www.openstreetmap.org/node/1063808111/history</a><br></div><div>** <a target="_blank" href="http://www.travelerscoffee.ru?utm_campaign=geo&utm_source=openstreetmap&utm_medium=link" rel="noopener noreferrer">http://www.travelerscoffee.ru?utm_campaign=geo&utm_source=openstreetmap&utm_medium=link</a><br></div><div>* <a target="_blank" href="https://www.openstreetmap.org/node/6817678019/history" rel="noopener noreferrer">https://www.openstreetmap.org/node/6817678019/history</a><br></div><div>** <a target="_blank" href="https://www.resotainer.fr/agence-bonneuil-sur-marne?utm_source=open-street-map&utm_medium=recherche-locale&utm_content=openstreetmap&utm_campaign=open-street-map-garde-meubles-bonneuil-sur-marne" rel="noopener noreferrer">https://www.resotainer.fr/agence-bonneuil-sur-marne?utm_source=open-street-map&utm_medium=recherche-locale&utm_content=openstreetmap&utm_campaign=open-street-map-garde-meubles-bonneuil-sur-marne</a><br></div><div>* <a target="_blank" href="https://www.openstreetmap.org/node/1684317522" rel="noopener noreferrer">https://www.openstreetmap.org/node/1684317522</a><br></div><div>** <a target="_blank" href="http://www.travelerscoffee.ru?utm_campaign=geo&utm_source=openstreetmap&utm_medium=link" rel="noopener noreferrer">http://www.travelerscoffee.ru?utm_campaign=geo&utm_source=openstreetmap&utm_medium=link</a><br></div><div><br></div><div>In general I have not noticed correlation between presence of tracking links<br></div><div>and additional issues that would not be detected automatically.<br></div><div><br></div><div>Therefore automatic removal of tracking parameters is not causing loss of<br></div><div>useful indicators of areas that should be reviewed.<br></div><div>Osmose and JOSM validators and StreetComplete are offering many better indicators,<br></div><div>and we are not in danger of running out of places where human intervention is clearly needed.<br></div><div><br></div><div>Automatic removal would allow me and others to spend time on something more useful,<br></div><div>than reviewing all cases where tracking is clearly present and confirming them one by one.<br></div><div><br></div><div>Proposed bot edit would remove links where all used parameters are tracking<br></div><div>users and may be removed.<br></div><div><br></div><div>I am reviewing manually more complicated cases to catch<br></div><div>also currently unknown tracking parameters.<br></div><div><br></div><div>Anchors (#section) will be preserved.<br></div><div><br></div><div>Code is tested, was using it in a manual review mode and for a fully automated edit run<br></div><div>that removed tracking parameters from over 1000 objects - see<br></div><div><a target="_blank" href="https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account/remove_tracking_parameters" rel="noopener noreferrer">https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account/remove_tracking_parameters</a><br></div><div><br></div><div>I have experience with automated edits, see<br></div><div><a target="_blank" href="https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account" rel="noopener noreferrer">https://wiki.openstreetmap.org/wiki/Mechanical_Edits/Mateusz_Konieczny_-_bot_account</a><br></div><div><br></div><div>Yes, editing element will cause it to be edited and change "last edited" date.<br></div><div>Effect will be exactly the same in case of using bot and manual edit<br></div><div>(which would be necessary in case of rejecting this automated edit proposal).<br></div><div>Note that in case of bot edits you may filter out bot edits marked as automatic.<br></div><div><br></div><div>following are consider as tracking parameters and would be removed:<br></div><div><br></div><div>fbclid, gclid, campaign_ref, mc_id, utm_source, utm_medium, utm_term,<br></div><div>utm_content, utm_campaign, utm_id, gclsrc, dclid, wt.tsrc, WT.tsrc,<br></div><div>zanpid, yclid, utm_campain, trkCampaign, mkt_tok, sc_campaign, sc_channel,<br></div><div>sc_content, sc_medium, sc_outcome, sc_geo, sc_country, mbid, cmpid,<br></div><div>campaign_id, Campaign, fb_action_ids, fb_action_types, fb_ref, fb_source,<br></div><div>gs_l, _hsenc, igshid, CampIDMin, CampIDMaj, campaign, Campaign,<br></div><div>campaignid, campaignId, adid, adgroupid, refr, referrer, cm_mmc, lw_cmp,<br></div><div>CLID, ReferralSource, SourceID, trkid, adjust_creative, partner_slug, y_source,<br></div><div>oppartnerid, padid, otppartnerid, ref_device_id, utm_kxconfid, SEO_id,<br></div><div>originalReferrer, spMailingID, hsCtaTracking<br></div></div><div>_______________________________________________<br></div><div>talk mailing list<br></div><div><a target="_blank" href="mailto:talk@openstreetmap.org" rel="noopener noreferrer">talk@openstreetmap.org</a><br></div><div><a target="_blank" href="https://lists.openstreetmap.org/listinfo/talk" rel="noopener noreferrer">https://lists.openstreetmap.org/listinfo/talk</a><br></div></blockquote></div></div></blockquote><div><br></div></div><div>_______________________________________________<br></div><div> talk mailing list<br></div><div> <a target="_blank" rel="noopener noreferrer" href="mailto:talk@openstreetmap.org">talk@openstreetmap.org</a><br></div><div> <a target="_blank" rel="noopener noreferrer" href="https://lists.openstreetmap.org/listinfo/talk">https://lists.openstreetmap.org/listinfo/talk</a><br></div></blockquote></div><div>_______________________________________________<br></div><div> talk mailing list<br></div><div> <a rel="noopener noreferrer" target="_blank" href="mailto:talk@openstreetmap.org">talk@openstreetmap.org</a><br></div><div> <a target="_blank" rel="noopener noreferrer" href="https://lists.openstreetmap.org/listinfo/talk">https://lists.openstreetmap.org/listinfo/talk</a><br></div></blockquote></div></blockquote><div><br></div> </body>
</html>