[OSM-dev] Comparing quality of different geocoders?

[Sarah Hoffmann]

Hi,

On Wed, Aug 26, 2020 at 09:11:44AM +0200, Mateusz Konieczny via dev wrote:
> Is anyone aware about some test suite comparing different geocoders?
> 
> Something with query + expected result pairs, and listing where Nominatim / Photon / etc succeeded/failed?
> 
> I want something like that, tried to find one and failed.
> 
> I want to ask whatever I missed something like that before I will make it.

There are a couple of test suits out there. The two that come
immediately to mind are:
https://github.com/geocoders/geocoder-tester
https://github.com/pelias/fuzzy-tester

The issue with all these is that you have to define what you
actually want to compare. Depending on what kind of queries you
run and how you define the results you get, you'll get very different
results.

Sarah