[OSM-dev] Importing Planet Into Hadoop/HBase

Lars Francke lars.francke at gmail.com
Fri Mar 5 20:16:14 GMT 2010


On Fri, Mar 5, 2010 at 20:59, Jeffrey Ollie <jeff at ocjtech.us> wrote:
> Has anyone looked at importing the planet into a Hadoop/HBase cluster?
>  I'm just learning about the whole clustering/cloud computing stuff so
> it might not be a good fit but I might give it a try, if only as a
> learning project.

Woaah! Yes! I wrote a blog entry[1] about it.
I've just arrived at home from FOSSGIS and we had a few very nice and
constructive discussions about this and other solutions. It is
certainly possible but it takes a lot more work than just writing it
all into a PostgreSQL schema. I've made a few sources available[2] but
nothing yet that writes into HBase - I'm currently cleaning that up.

I was planning to do a writeup about the architecture - I'll do it in
the next few days.

Feel free to contact me with specific questions.

Cheers,
Lars

[1] http://osmdoc.blogspot.com/2009/11/status-update.html
[2] http://wiki.openstreetmap.org/wiki/OSMdoc




More information about the dev mailing list