[OSM-dev] 'My first OSM experiences' - PDA Mapping software and the OSM mobile binary protocol

Brett Henderson brett at bretth.com
Wed Jan 7 23:25:55 GMT 2009


Karl Newman wrote:
> On Wed, Jan 7, 2009 at 2:28 PM, Brett Henderson <brett at bretth.com 
> <mailto:brett at bretth.com>> wrote:
>
>     Karl Newman wrote:
>
>         Heh, I was thinking along those lines, too, but I thought I'd
>         wait until your format stabilizes. It would be quite handy to
>         have a random-access data source for Osmosis without requiring
>         a database installation.
>
>     I'm not sure if you realise this but there already is one of
>     those.  I can't reach the wiki at the moment but the tasks in
>     question are:
>     --write-customdb
>     --read-customdb
>
>     I forget the details of the on-disk format but it's built around
>     the osmosis store classes so uses osmosis specific object
>     serialisation.
>
>     The --read-customdb task doesn't actually stream data to
>     downstream tasks, it provides the data in the form of a "dataset"
>     object.  This can be consumed by tasks such as --dataset-dump
>     which will stream from the dataset, but it can also be consumed by
>     any task wishing to access data randomly.
>
>     Performance isn't great for large datasets which is why I created
>     the pgsql-simple schema.  I've never been able to get an on-disk
>     format to scale nearly as well as a real database.
>
>     I also wrote a set of tasks based on one the Berkeley DB Java
>     Edition but deleted it because performance was even worse.
>
>     Brett
>
>
> Actually yes, I was aware of that one, but I recall that you said the 
> performance was not good and I thought you had removed that one for 
> performance reasons (I didn't pay close attention; I guess it was the 
> BDB that you removed instead).
I forget now :-)  I might have been going to remove it and changed my 
mind.  If new features come along that are difficult to support I'll 
drop it.  I don't think anybody uses it.





More information about the dev mailing list