[Talk-GB] [OHM] New York Public Library - Building Inspector

Rob Nickerson rob.j.nickerson at gmail.com
Wed May 21 21:41:58 UTC 2014


Good work Tim. It seems we have a lot of people interested in this. :-D

In regards to the NLS maps, I am having some trouble with the sample files
sent through to me. I sent them on to the guys from NYPL and even they
struggled. I've just contacted Chris at NLS to see if he can send me them
in a different file format.

Meanwhile there is a chance to improve the map vecotorizer tool. Currently
the way it works leaves a gap between terrace buildings. If you, or anyone
you know may be able to help solve this GIS problem (including post
processing), please get in touch. Details at:
https://github.com/NYPL/map-vectorizer/issues/19

Regards,
Rob


On 21 May 2014 22:31, Tim Waters <chippy2005 at gmail.com> wrote:

> Hi folks,
>
> I've heard back from the British Library - they are hugely interested with
> the Map-Vectorizer work - it's really encouraging.
>
> In brief they said that they were positive but that they'd need to get
> some things sorted first, looking at licensing, formats etc and they would
> update me soonish.
>
> In the meantime I suggest we go ahead with the NLS maps and see if we can
> get our stack up and running with those maps?
>
> Cheers,
>
> Tim
>
>
> On 18 May 2014 23:01, Rob Nickerson <rob.j.nickerson at gmail.com> wrote:
>
>> Nice work Tim.You're right about the traced and centroid JSON files.They
>> do indeed come out of the NYPL map-vectorizer [1]. I've got a version of
>> this up and running on my computer and have successfully vectorized the
>> test file.
>>
>> Chris Fleet (from NLS) has sent me some test maps, however these are Jpeg
>> 2000 files and are causing quite a bit of trouble so far. At first I
>> thought it was a bug in my computer (in the jasper library that's
>> responsible for opening jp2 files), but I tried a second computer today and
>> that failed to. I'll get in touch with Chris again. Meanwhile those BL Goad
>> maps look great. Let us know if you hear back from BL.
>>
>> Thanks for your help,
>> Rob
>>
>> [1] https://github.com/NYPL/map-vectorizer
>>
>>
>> On 18 May 2014 22:35, Tim Waters <chippy2005 at gmail.com> wrote:
>>
>>> Couple of things - building inspector update and British Library Goad
>>> maps.
>>>
>>> Building Inspector update:
>>>
>>> I've got it working and have put up an instance on heroku for the moment
>>> - Works well and it can handle 10K rows in the database for free.
>>>
>>> http://leatherwood.herokuapp.com/
>>> * It's just got about half of the NYPL data in it
>>> * Only Twitter log in will work for it.
>>> * Initially only the Check Polygons task will work until there's enough
>>> that's been checked, and then the other tasks become unlocked.
>>>
>>> The code is here: https://github.com/timwaters/building-inspector
>>>
>>> So, it does require some configuring. We need:
>>> * a tile set for the basemap
>>> Also - some files like what's in
>>> https://github.com/timwaters/building-inspector/tree/master/public/files:
>>> * ingestor_config_builder.py run on the geotiffs
>>> * The traced and centroid json files which I imagine are generated by
>>> the vectorising process.
>>>
>>> We'd also need to tweak the website blurb etc
>>>
>>> Overall it should be quite easy to get a pilot area done.
>>>
>>> -----
>>>
>>> British Library Goad Maps
>>>
>>> Like the NYPL's maps - these are fire insurance maps of the 19th century
>>> - they have various colours, addresses etc and great detail. They are the
>>> perfect thing for our Building Inspector. In addition, the coverage is
>>> immense. Major towns and cities in Ireland and the UK.
>>>
>>> http://www.bl.uk/onlinegallery/onlineex/firemaps/fireinsurancemaps.html
>>>
>>> I've reached out via Twitter and via email to the Library asking for a
>>> couple of maps for a pilot area to look at.
>>>
>>> Cheers,
>>>
>>> Tim
>>>
>>>
>>>
>>>
>>> On 16 May 2014 19:57, Rob Nickerson <rob.j.nickerson at gmail.com> wrote:
>>>
>>>> Thanks for you help Tim,
>>>>
>>>> The NYPL code is here:
>>>> https://github.com/NYPL/building-inspector/
>>>>
>>>> I'm assuming it's rails as that's mentioned in some of the code
>>>> commits, but I don't know any more than that.
>>>>
>>>> Best,
>>>> Rob
>>>>
>>>> p.s. The code for vectorizing maps is also on GitHub. Chris has sent me
>>>> a couple of GeoTIFs so I'm going to have a go with them this weekend.
>>>>
>>>>
>>>>
>>>> On 16 May 2014 12:51, Tim Waters <chippy2005 at gmail.com> wrote:
>>>>
>>>>> I might have some time this weekend to look at the Rails side of
>>>>> things (that is, if no one else has made any progress)
>>>>>
>>>>> Will ping back in a couple of days
>>>>>
>>>>> Tim
>>>>>
>>>>>
>>>>> On 12 May 2014 21:08, Rob Nickerson <rob.j.nickerson at gmail.com> wrote:
>>>>>
>>>>>> Hi Steven,
>>>>>>
>>>>>> Thanks for the offer of help. Yesterday I managed to get the NYPL
>>>>>> vectorizer working (this is the tool that has a first stab at creating
>>>>>> vectors from the map). I did this on a small screenshot of NLS's London
>>>>>> maps. I've asked Chris if he could send me a GeoTIF to do a larger scale
>>>>>> test.
>>>>>>
>>>>>> Some of the key areas that I think need addressing:
>>>>>>
>>>>>> * Improving the automated vectorizer. Currently the vectorizer
>>>>>> creates polygons of the inside of buildings (rather than following the
>>>>>> wall). For a terraced street this produces a row of detached buildings.
>>>>>> Some processing could improve this. I guess this could be done before,
>>>>>> after, or both before and after the polygon has been processed by the human
>>>>>> volunteers on the website.
>>>>>> * The website looks like it's a Rails site. I would need a lot of
>>>>>> help with this as it's an area I know very little about.
>>>>>>
>>>>>> Are you able to help with either of these?
>>>>>>
>>>>>> Kind regards,
>>>>>> Rob
>>>>>>
>>>>>>
>>>>>> On 12 May 2014 16:26, Steven Horner <steven at stevenhorner.com> wrote:
>>>>>>
>>>>>>> Hello,
>>>>>>>
>>>>>>> I would be happy to help in anyway and have previously had a
>>>>>>> conversation with Chris at NLS regarding helping georeference some of their
>>>>>>> maps.
>>>>>>>
>>>>>>> I had been looking into creating my own historical version of OSM
>>>>>>> for a local personal project, when I looked a few weeks ago Open Historical
>>>>>>> Map was down and was never very usable before that. It sounds like from the
>>>>>>> WIKI things maybe starting to happen, date slider planned, etc.
>>>>>>>
>>>>>>> regards,
>>>>>>> Steven
>>>>>>>
>>>>>>>
>>>>>>> On Sat, May 10, 2014 at 10:04 PM, Rob Nickerson <
>>>>>>> rob.j.nickerson at gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi All, Historic Map folks,
>>>>>>>>
>>>>>>>> I have now heard from Chris at National Library of Scotland (NLS).
>>>>>>>> He is very supportive* of the idea of using something similar to the NYPL
>>>>>>>> Building Inspector software and website for digitizing some of NLS's
>>>>>>>> historic maps. As NYPL have made all their software Open Source, it should
>>>>>>>> be relatively easy to roll this out with NLS's (or other) maps.
>>>>>>>>
>>>>>>>> Who's interested in getting involved? You lot set the pace of this
>>>>>>>> :-D
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>> Rob
>>>>>>>>
>>>>>>>> * NLS would be able to supply the scanned and geo-rectified maps.
>>>>>>>> As with everyone else their ability to do any more is limited by their
>>>>>>>> level of funding. This should not be a problem as we can self host the
>>>>>>>> website.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/talk-gb/attachments/20140521/f429ee56/attachment-0001.html>


More information about the Talk-GB mailing list