[OSM-dev] OSM and CouchDB/GeoCouch
Andreas Kalsch
andreaskalsch at gmx.de
Mon Jul 5 19:43:19 BST 2010
What about rewriting this stuff in C? I have written a MySQL importer in
C some time ago, so what about reusing its XML parsing part?
If you are interested, I'll put it on Github.
Andi
Am 03.07.10 22:43, schrieb Ian Dees:
> On Sat, Jul 3, 2010 at 1:17 PM, Nolan Darilek <nolan at thewordnerd.info
> <mailto:nolan at thewordnerd.info>> wrote:
>
> On 07/03/2010 01:09 PM, Nolan Darilek wrote:
>
> On 07/02/2010 01:52 PM, Serge Wroclawski wrote:
>
> Similarly, Ian Dees and I have written a server using
> MongoDB, which
> also provides functionality such as auto-sharding and built in
> map/reduce.
>
>
> Is this work available anywhere? How did you find performance
> to be, and to what uses did you put it?
>
> I've done some experiments creating a LibOSM MongoDB backend
> and found its performance fairly bad, but I don't have the
> most optimal server for it, and probably didn't use MongoDB to
> its limits. If you experienced good performance for real-time
> operations then I'd be very interested in seeing how you
> managed it so I might adopt the techniques and see if I have
> any better luck.
>
> It seemed to me that a dump of the entire planet would require
> a substantial server to serve up, so I abandoned the work, but
> would very much like to revive it if it's at all workable.
>
>
> The code is here: http://github.com/iandees/mongosm
>
> It took several days to import a planet file. The majority of the CPU
> time was spent serializing/deserializing BSON in Python and the Mongo
> server had very little CPU time so if I use a language with a faster
> BSON implementation it might be faster.
>
> Serge was working on a way to import diff files to maintain mintutely
> updates.
>
> I was working on an HTTP API interface.
>
>
> _______________________________________________
> dev mailing list
> dev at openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20100705/a73fac93/attachment.html>
More information about the dev
mailing list