[OSM-dev] Importing Planet Into Hadoop/HBase
Lars Francke
lars.francke at gmail.com
Fri Mar 5 20:16:14 GMT 2010
On Fri, Mar 5, 2010 at 20:59, Jeffrey Ollie <jeff at ocjtech.us> wrote:
> Has anyone looked at importing the planet into a Hadoop/HBase cluster?
> I'm just learning about the whole clustering/cloud computing stuff so
> it might not be a good fit but I might give it a try, if only as a
> learning project.
Woaah! Yes! I wrote a blog entry[1] about it.
I've just arrived at home from FOSSGIS and we had a few very nice and
constructive discussions about this and other solutions. It is
certainly possible but it takes a lot more work than just writing it
all into a PostgreSQL schema. I've made a few sources available[2] but
nothing yet that writes into HBase - I'm currently cleaning that up.
I was planning to do a writeup about the architecture - I'll do it in
the next few days.
Feel free to contact me with specific questions.
Cheers,
Lars
[1] http://osmdoc.blogspot.com/2009/11/status-update.html
[2] http://wiki.openstreetmap.org/wiki/OSMdoc
More information about the dev
mailing list