[OSM-talk] Report on the OSMF 2021 Survey after One Week

[Mateusz Konieczny]

Jan 24, 2021, 04:13 by allan.mustard at osmfoundation.org:

>
> A sum of 1,918 total responses means the survey features a 2.24%        confidence interval at the 95% confidence level, and a 2.95%        confidence interval at the 99% confidence level. 
>
>
What are assumptions for that? Because given inherently biased samples (biased in way
not allowing for balancing/adjusting - survey is made because demographics are unknown!),
I am pretty sure that it is misleading to include such statistics.

We do not know how strong bias, even type of it and we can only guess how sample
of survey-takers is biased compared to general community (and there is tradictional
problem of people trying to manipulate survey by taking it multiple times,
strategic refusal to answer some questions about demographics or just lying).

For example if some group is overrepresented or underrepresented compared to
demographic of OSM mappers this survey is unable to detect it!  

In real situation even with 5 000 people answering it is likely that 
real confidence interval may be 20% or 10% of 1% - and we do not know
which one would be correct!

> The URL of the survey        is > https://osmf.limequery.org/281662
>
Keeping it to repeat request to distribute news about this survey.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/talk/attachments/20210124/c6081cef/attachment.htm>