<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body bgcolor=white lang=EN-AU link=blue vlink=purple><div class=WordSection1><p class=MsoNormal style='margin-left:36.0pt'><b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext'>From:</span></b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext'> Paul Norman [mailto:penorman@mac.com] <br><b>Sent:</b> Monday, 26 January 2015 11:49 PM</span><span style='color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><br><span style='color:#1F497D'>> </span>You are proposing to use bulk_upload.py. Have you tested it on the dev servers? It is known for being tricky. You will<span style='color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><span style='color:#1F497D'>> </span>also need to make sure that your changesets are a reasonable size, probably under 10 000.<br><br><span style='color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>I did try uploading an earlier version of the file to the dev servers. It took a few hours in total. I needed to restart the script a few times, either because it stopped with a network error or became unresponsive. Each time I restarted, the upload appeared to successfully resume. The changeset size is hard-coded to 50000 in the script, but based on your comment I will modify the source code to reduce it to 10000. Perhaps I should spend some time investigating why bulk_upload.py is unreliable, with the aim of improving it for everybody.<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><br><span style='color:#1F497D'>></span> Some features have a name of (disused) and appear disused<br><br><span style='color:#1F497D'>> </span>I selected random dams, and about 30-40% didn't have any sign of water on Bing. I'm aware of the cyclical nature of<span style='color:#1F497D'><br>> </span>water features in Australia, but several of them showed no signs of water nor did they seem like a likely location to have <span style='color:#1F497D'>> </span>a new dam built.<span style='color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>South Australia is the driest state in Australia, so most dams in the state would be completely dry for some part of the year. Dams typically aren’t located on a river or stream, or have a wall. I looked at a random subset of 100 of the dams in Bing. Of those, 53 showed clear signs of water. 42 looked quite clearly like dams that happened to not have water at the time, presumably due to dry weather. In five cases, I couldn’t see an obvious sign of a dam. Perhaps in some cases the dam was too shallow to be visible (and empty at the time). However it does suggest the possibility that some small proportion of the features are wrong. <o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><br><br><span style='color:#1F497D'>></span> Other features did not have a great accuracy rate, although it is harder to tell wetlands from the air<br><br><span style='color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>I agree that there is a proportion of the lakes and wetland features that, like some of the dams, don’t make sense when comparing to the Bing maps. My overall sense from looking at Bing and from comparing with areas that I am familiar with is that the accuracy is of the dataset is good in general. I am encouraged by the fact that it is an authoritative source.<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><br><span style='color:#1F497D'>> </span>Many features are badly overnoded (e.g. the water at -34.21985 140.35764). A simplify with a 2m threshold in JOSM<span style='color:#1F497D'><br>> </span>brought the number of nodes down ten-fold for some features.<br><br><span style='color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>Based on your comments I have now run the SimplifyArea plugin on the entire data (using the default parameters). This has reduced the total node count in the file to be uploaded by 23%.<o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><br><span style='color:#1F497D'>></span> Best practice would not be to include datasa:FEATURECOD and datasa:OBJECTID<span style='color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>Based on your comment, I have removed these tags. <o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><br><span style='color:#1F497D'>></span> Opinion is divided on if source is necessary with a source tag on the changeset<span style='color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal style='margin-left:36.0pt'><br><span style='color:#1F497D'>></span> What kind of plans are there for updates?<o:p></o:p></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>The source dataset doesn’t appear to get updated very often. (The latest version is dated July 2014). If updated versions of the source data are made available in the future, I will perform the processing steps again, to import new features. However I am not planning to handle features that change shape, change tags, or are deleted.<o:p></o:p></span></p></div></body></html>