[OSM-dev] planet.osm

[Nick Burch]

On Fri, 25 Aug 2006, Nick Whitelegg wrote:
> Do you mean .pl? It stores every node in memory so for a whole planet 
> that might be a problem.

It stores the ID of every node and segment in the bounding box it's 
handling, so it can tell if a segment is invalid (missing its nodes) or 
way is missing segments.

I found it took about 1.6gb to do the whole planet, but only about 500mb 
if you exclude USA + Canada (just uncomment @exclude_bbox on line 22)


Does anyone know of a more memory efficient way to do a hashset in perl? 
I'm currently using a normal perl hash, but all we really need to be able 
to do is add ids to a hashset, and check if they're there.

Nick (Burch)