[OSM-talk-be] duplicates originating from GRB merge

[Glenn Plas]

Hi Seppe,

Sorry it took me a while to open my mailbox lately.

On 02-06-17 19:22, Santens Seppe wrote:
> Hey guys,
> 
> From time to time, I'm seeing duplicate nodes or areas that I reckon are
> due to (wrong use) of the GRB merge tools. One striking example:
> https://www.openstreetmap.org/note/1017110 (let the JOSM validator run
> on this area)

It looks indeed a problem caused by the user, exporting twice, it's kind
of strange this goes unnoticed by the mapper.  I think the docs of the
development tool clearly says to validate and validate again.

Right now it's impossible to be caused by the database, in the past if a
building was in 2 different datasets (at a province border usually) it
got double exported.  This is fixed now, even when the source data
shares objects(even in de database), only 1 will be extracted.

> 
> Is there any news about the tools? I see they are being used quite
> often, but probably not always in the correct way. I guess making them
> somewhat "dummy proof" would help (I'm also speaking for myself :-) )...

A new tool is in development [1], taking in all what was learned and
building a better one.  Making it a bit more dummy-proof is perhaps an
option but it is intended for seasoned mappers in the first place.

There is also a tool[2] based on terraform/google cloud to build the
database from scratch (and translating tags/keys), it's working 100% but
the OSM translations of quite a few objects isn't implemented yet.   The
data in the test/dev tool is therefor changed and less correct
(building='verdieping' is now in there, it wasn't before).  The GRB data
was already a year old so I rebuilt it but this time 100% automated and
I still have to add those queries to the postprocessing.

I have fixed that area you mentioned but I haven't doublechecked the
area yet.

There is a screenshot[3] too if you're curious.

Thanks for doing this Q/A work and reporting it.

Glenn



[1] https://github.com/gplv2/grbtool
[2] https://github.com/gplv2/grb-postgis
[3]
https://raw.githubusercontent.com/gplv2/grbtool/master/screenshots/grbtool_new.png