[Talk-in] PMGSY rural connectivity open data

[Nikhil VJ]

Hi All,

I've created an application where we can compare PMGSY and OSM rural
Habitations data:
https://server.nikhilvj.co.in/pmgsy/

Source code: https://github.com/answerquest/pmgsy_osm_comparison

Right-click on the map to load all habitations for that area (what they
call Block).
If you scroll below the first table, You'll find an OSM button - click it
to fetch rural places tagged "place=village" / "place=hamlet" /
"place=isolated_dwelling". (points and centroids of areas)

The app will pull those from overpass, then compare with the Habitations
data to show nearby and far OSM places.

There's also a feedback layer built : You can submit feedback for a PMGSY
Habitation or an OSM place.
(Input side is ready; output side still work to do)

There is an "Edit in OSM" button below the map - clicking that will open up
main website OSM Editor, with the block's boundary loaded as guide so that
you can map.

There's more we can do with this - one idea is to make this a place where
we can link up PMGSY and OSM ids and have feedback flow both ways.
Another is to vet the data and filter out the Habitations that are suitable
candidates for a bulk import into OSM.

Inviting inputs and collaborations.

API doc: https://server.nikhilvj.co.in/pmgsy/docs/
Tech stack: Backend: Python3 FastAPI
DB: PostGreSQL, same one as in
https://github.com/answerquest/import_geosadak

I've also run an analysis on every state > district > block and created a
stats CSV which gives numbers of habitations, OSM places, near/far breakup
etc. You'll find it in the repo.
This project is a work in progress, so if you're reading this a week or
month later, things may have changed.

Screenshots:









--
Cheers,
Nikhil VJ
https://nikhilvj.co.in


On Thu, Mar 3, 2022 at 12:32 PM Nikhil VJ <nikhil.js at gmail.com> wrote:

> Hi, I've imported the data to a PostGreSQL DB on my webserver - I think
> it'll be useful to have it in that form to be able to do more with it.
>
> I've shared the import script and steps in this repo if anyone wants to
> load it into their own DB:
> https://github.com/answerquest/import_geosadak
>
> Some data inconsistencies found:
> States having BLOCK_ID values in boundaries shapefile which does not have
> matching Master data entry:
> TamilNadu - 3
> JammuAndKashmir - 3
> These blocks do have road data etc but no entry in master data excel:
> 8108, 8105, 8106, 8063, 8034, 8041
>
> States having BLOCK_ID=0 in their block boundary shapefile:
> Punjab - 1
> WestBengal - 3
> I've imported these boundaries with randomly assigned block ids. We'll
> need to match them to actual block id.
>
> Limited offer: If someone wants to query my DB then pls contact me on
> nikhil.js (at) gmail.com for credentials (limited capacity and bandwidth,
> note).
>
> --
> Cheers,
> Nikhil VJ
> https://nikhilvj.co.in
>
>
> On Sat, Feb 26, 2022 at 12:40 PM Arun Ganesh <arun.planemad at gmail.com>
> wrote:
>
>> Wiki page outlining the data and notes to plan an import
>> https://wiki.openstreetmap.org/wiki/India/PMGSY_rural_connectivty_data_import
>> _______________________________________________
>> Talk-in mailing list
>> Talk-in at openstreetmap.org
>> https://lists.openstreetmap.org/listinfo/talk-in
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/talk-in/attachments/20220521/bccb47b8/attachment.htm>