[Talk-GB] [OHM] New York Public Library - Building Inspector

Rob Nickerson rob.j.nickerson at gmail.com
Thu May 22 22:44:48 UTC 2014


I've now had updated map files through from NLS and these work well. The
main priorities now are:

* Website - we need to think about the design. I've just raised this with
Chris at the NLS to get his thoughts (it is after all their maps at the
moment).

* Improving the vectorizer so that we don't end up with a gap between
terrace buildings. Help from the GIS community would be great. See the bug
details at https://github.com/NYPL/map-vectorizer/issues/19

Regards,
Rob


On 21 May 2014 22:41, Rob Nickerson <rob.j.nickerson at gmail.com> wrote:

> Good work Tim. It seems we have a lot of people interested in this. :-D
>
> In regards to the NLS maps, I am having some trouble with the sample files
> sent through to me. I sent them on to the guys from NYPL and even they
> struggled. I've just contacted Chris at NLS to see if he can send me them
> in a different file format.
>
> Meanwhile there is a chance to improve the map vecotorizer tool. Currently
> the way it works leaves a gap between terrace buildings. If you, or anyone
> you know may be able to help solve this GIS problem (including post
> processing), please get in touch. Details at:
> https://github.com/NYPL/map-vectorizer/issues/19
>
> Regards,
> Rob
>
>
> On 21 May 2014 22:31, Tim Waters <chippy2005 at gmail.com> wrote:
>
>> Hi folks,
>>
>> I've heard back from the British Library - they are hugely interested
>> with the Map-Vectorizer work - it's really encouraging.
>>
>> In brief they said that they were positive but that they'd need to get
>> some things sorted first, looking at licensing, formats etc and they would
>> update me soonish.
>>
>> In the meantime I suggest we go ahead with the NLS maps and see if we can
>> get our stack up and running with those maps?
>>
>> Cheers,
>>
>> Tim
>>
>>
>> On 18 May 2014 23:01, Rob Nickerson <rob.j.nickerson at gmail.com> wrote:
>>
>>> Nice work Tim.You're right about the traced and centroid JSON files.They
>>> do indeed come out of the NYPL map-vectorizer [1]. I've got a version of
>>> this up and running on my computer and have successfully vectorized the
>>> test file.
>>>
>>> Chris Fleet (from NLS) has sent me some test maps, however these are
>>> Jpeg 2000 files and are causing quite a bit of trouble so far. At first I
>>> thought it was a bug in my computer (in the jasper library that's
>>> responsible for opening jp2 files), but I tried a second computer today and
>>> that failed to. I'll get in touch with Chris again. Meanwhile those BL Goad
>>> maps look great. Let us know if you hear back from BL.
>>>
>>> Thanks for your help,
>>> Rob
>>>
>>> [1] https://github.com/NYPL/map-vectorizer
>>>
>>>
>>> On 18 May 2014 22:35, Tim Waters <chippy2005 at gmail.com> wrote:
>>>
>>>> Couple of things - building inspector update and British Library Goad
>>>> maps.
>>>>
>>>> Building Inspector update:
>>>>
>>>> I've got it working and have put up an instance on heroku for the
>>>> moment - Works well and it can handle 10K rows in the database for free.
>>>>
>>>> http://leatherwood.herokuapp.com/
>>>> * It's just got about half of the NYPL data in it
>>>> * Only Twitter log in will work for it.
>>>> * Initially only the Check Polygons task will work until there's enough
>>>> that's been checked, and then the other tasks become unlocked.
>>>>
>>>> The code is here: https://github.com/timwaters/building-inspector
>>>>
>>>> So, it does require some configuring. We need:
>>>> * a tile set for the basemap
>>>> Also - some files like what's in
>>>> https://github.com/timwaters/building-inspector/tree/master/public/files:
>>>> * ingestor_config_builder.py run on the geotiffs
>>>> * The traced and centroid json files which I imagine are generated by
>>>> the vectorising process.
>>>>
>>>> We'd also need to tweak the website blurb etc
>>>>
>>>> Overall it should be quite easy to get a pilot area done.
>>>>
>>>> -----
>>>>
>>>> British Library Goad Maps
>>>>
>>>> Like the NYPL's maps - these are fire insurance maps of the 19th
>>>> century - they have various colours, addresses etc and great detail. They
>>>> are the perfect thing for our Building Inspector. In addition, the coverage
>>>> is immense. Major towns and cities in Ireland and the UK.
>>>>
>>>> http://www.bl.uk/onlinegallery/onlineex/firemaps/fireinsurancemaps.html
>>>>
>>>> I've reached out via Twitter and via email to the Library asking for a
>>>> couple of maps for a pilot area to look at.
>>>>
>>>> Cheers,
>>>>
>>>> Tim
>>>>
>>>>
>>>>
>>>>
>>>> On 16 May 2014 19:57, Rob Nickerson <rob.j.nickerson at gmail.com> wrote:
>>>>
>>>>> Thanks for you help Tim,
>>>>>
>>>>> The NYPL code is here:
>>>>> https://github.com/NYPL/building-inspector/
>>>>>
>>>>> I'm assuming it's rails as that's mentioned in some of the code
>>>>> commits, but I don't know any more than that.
>>>>>
>>>>> Best,
>>>>> Rob
>>>>>
>>>>> p.s. The code for vectorizing maps is also on GitHub. Chris has sent
>>>>> me a couple of GeoTIFs so I'm going to have a go with them this weekend.
>>>>>
>>>>>
>>>>>
>>>>> On 16 May 2014 12:51, Tim Waters <chippy2005 at gmail.com> wrote:
>>>>>
>>>>>> I might have some time this weekend to look at the Rails side of
>>>>>> things (that is, if no one else has made any progress)
>>>>>>
>>>>>> Will ping back in a couple of days
>>>>>>
>>>>>> Tim
>>>>>>
>>>>>>
>>>>>> On 12 May 2014 21:08, Rob Nickerson <rob.j.nickerson at gmail.com>wrote:
>>>>>>
>>>>>>> Hi Steven,
>>>>>>>
>>>>>>> Thanks for the offer of help. Yesterday I managed to get the NYPL
>>>>>>> vectorizer working (this is the tool that has a first stab at creating
>>>>>>> vectors from the map). I did this on a small screenshot of NLS's London
>>>>>>> maps. I've asked Chris if he could send me a GeoTIF to do a larger scale
>>>>>>> test.
>>>>>>>
>>>>>>> Some of the key areas that I think need addressing:
>>>>>>>
>>>>>>> * Improving the automated vectorizer. Currently the vectorizer
>>>>>>> creates polygons of the inside of buildings (rather than following the
>>>>>>> wall). For a terraced street this produces a row of detached buildings.
>>>>>>> Some processing could improve this. I guess this could be done before,
>>>>>>> after, or both before and after the polygon has been processed by the human
>>>>>>> volunteers on the website.
>>>>>>> * The website looks like it's a Rails site. I would need a lot of
>>>>>>> help with this as it's an area I know very little about.
>>>>>>>
>>>>>>> Are you able to help with either of these?
>>>>>>>
>>>>>>> Kind regards,
>>>>>>> Rob
>>>>>>>
>>>>>>>
>>>>>>> On 12 May 2014 16:26, Steven Horner <steven at stevenhorner.com> wrote:
>>>>>>>
>>>>>>>> Hello,
>>>>>>>>
>>>>>>>> I would be happy to help in anyway and have previously had a
>>>>>>>> conversation with Chris at NLS regarding helping georeference some of their
>>>>>>>> maps.
>>>>>>>>
>>>>>>>> I had been looking into creating my own historical version of OSM
>>>>>>>> for a local personal project, when I looked a few weeks ago Open Historical
>>>>>>>> Map was down and was never very usable before that. It sounds like from the
>>>>>>>> WIKI things maybe starting to happen, date slider planned, etc.
>>>>>>>>
>>>>>>>> regards,
>>>>>>>> Steven
>>>>>>>>
>>>>>>>>
>>>>>>>> On Sat, May 10, 2014 at 10:04 PM, Rob Nickerson <
>>>>>>>> rob.j.nickerson at gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hi All, Historic Map folks,
>>>>>>>>>
>>>>>>>>> I have now heard from Chris at National Library of Scotland (NLS).
>>>>>>>>> He is very supportive* of the idea of using something similar to the NYPL
>>>>>>>>> Building Inspector software and website for digitizing some of NLS's
>>>>>>>>> historic maps. As NYPL have made all their software Open Source, it should
>>>>>>>>> be relatively easy to roll this out with NLS's (or other) maps.
>>>>>>>>>
>>>>>>>>> Who's interested in getting involved? You lot set the pace of this
>>>>>>>>> :-D
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Rob
>>>>>>>>>
>>>>>>>>> * NLS would be able to supply the scanned and geo-rectified maps.
>>>>>>>>> As with everyone else their ability to do any more is limited by their
>>>>>>>>> level of funding. This should not be a problem as we can self host the
>>>>>>>>> website.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/talk-gb/attachments/20140522/87fbeed8/attachment.html>


More information about the Talk-GB mailing list