[Taginfo-dev] dockerized-taginfo - for every country

[Imre Samu]

I have added some new areas ( no daily refresh )

Asia:                        http://taginfo-dev.opengeodata.hu/asia/   (  5
area:  Indonesia, Sri Lanka, Myanmar, Mongolia, Nepal )
Australia-Oceania:  http://taginfo-dev.opengeodata.hu/australia-oceania/  (
8 area )
Europe :                  http://taginfo-dev.opengeodata.hu/europe/  ( 5
area :   Romania, Berlin, Iceland, Istanbul )
North America         http://taginfo-dev.opengeodata.hu/north-america/   (
British Columbia, Greenland, Mexico, California, Mississippi )
South America        http://taginfo-dev.opengeodata.hu/south-america/  (
Bolivia, Columbia, Peru, Paraguay )
Russia:                    http://taginfo-dev.opengeodata.hu/russia/     (
Altai Rep, Komi Rep, Saint Petersburg, Republic of Mordovia, Tatarstan )

if somebody wants to test some special area -please write me!


My biggest problem:
-  Antimeridian  -  example:   New Zealand Maps  not working (
http://ao-nz.taginfo-dev.opengeodata.hu/keys/highway#map )
Planned Quick&dirty solution:    I will  modify the New Zealand  ( and
other countries ) Polygons   - so it will not touch the  Antimeridian    (
but the statistics will be worse )

And there are a lot of small problems ..
-  small area background map is not perfect ( now I am using natural earth
raster data,  )
-  job processing is not perfect, detecting errors is not always easy.

Current Status:
- 131 running taginfo container ( alpine linux + ruby )  + proxy +
webserver ...   (  my dev system = 15Gb RAM , 6 core )

now the memory:
root at scw-343bdf:/mnt/data/dockerized-taginfo# free -m
              total        used        free      shared  buff/cache
 available
Mem:          15019        2990         974         174       11054
 11535
Swap:             0           0           0

For refreshing the data ( taginfo processing)  at least 5-10 GB Free RAM
need ...  but for the big countries, probably more ...  ( Canada, US,
France, Germany )

For detecting "Long tail" errors I am using the high  detail settings,
*            "min_count_tags": 1,*
            // Tag combinations not appearing this often are not written to
database.
*            "min_tag_combination_count": 1,*
            // Minimum number of tag occurances for creating a map
*            "min_count_for_map": 1,*
            // Minimum number of relations per type to make this
            // relation type "interesting", ie. to make it show
            // up as a relation type.
*            "min_count_relations_per_type": 1,*

With some "basic"   source code customisation  ( some is not optimal yet )

 && sed -i 's/100/10/g'
 /osm/taginfo/sources/master/master.sql \
 && sed -i 's/(default 10000)/(default 10)/g'
 /osm/taginfo/web/lib/api/v4/keys.rb \
 && sed -i 's/min_count = 10000/min_count = 10/g'
 /osm/taginfo/web/lib/api/v4/keys.rb \
 && sed -i 's/count_all_common >= 10000/count_all_common >= 10/g'
/osm/taginfo/web/lib/api/v4/keys.rb \



For the future I have 2 plan:
A: Finding a sponsor and running 200-300  important  areas in a container

B: Creating about ~4000 config files ( in the github repo ) and with a
simple quickstart everybody can run the selected local taginfo.

the planned process for the "B"   ( not working yet )

git clone https://github.com/taginfo/dockerized-taginfo.git
cd dockerized-taginfo
make build
cd ./service/eu            // select Europe
make taginfo-eu-de-be     //  Create "Berlin" taginfo with downloading and
processing osm data, and start the web frontend

and open the browser: 127.0.0.1:20132


Regards,
 Imre





2018-03-13 23:17 GMT+01:00 Imre Samu <pella.samu at gmail.com>:

> Hi,
>
> If you have some time,
>     please help testing my development taginfo service.
>
>
> 3 test continent:
> ==================
> http://taginfo-dev.opengeodata.hu/africa/                  ~ 65 Taginfo
> service
> http://taginfo-dev.opengeodata.hu/antarctica/           ~  1 Taginfo
> service
> http://taginfo-dev.opengeodata.hu/central-america/  ~ 33 Taginfo service
> ========================================================
> = 99 Test taginfo service ( Dockerized - on the same server )
>
> for example:
> * in Antartica   http://aq-aq.taginfo-dev.opengeodata.hu/keys/amenity#
> values
> We have
> - 5 toilets
> - 2 Bank
> - 1 Atm
> - 2 cafe
> ( The Overpass link from Taginfo is not working for Antartica:
>   https://github.com/drolbr/Overpass-API/issues/421 )
>
> or other countries:
> * South Africa  :  http://af-za.taginfo-dev.opengeodata.hu/
> * Costa Rica : http://ca-cr.taginfo-dev.opengeodata.hu/
> * Morocco : http://af-ma.taginfo-dev.opengeodata.hu/
> * ...
>
> Github: https://github.com/taginfo/dockerized-taginfo
>
> Regards,
>  Imre
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/taginfo-dev/attachments/20180320/e4c1ce17/attachment.html>