[OSM-talk] planet.dump

Nick Burch openstreetmap at gagravarr.org
Wed Aug 2 10:57:22 BST 2006


On Wed, 2 Aug 2006, SteveC wrote:
> I'm running a planet dump right now, it's been taking a while :-/

OOI, how much memory is it munching?

(From looking at the code, we could ditch the nodes list after we've done 
the segments, but before we do the ways/areas. Only worth it though if 
we're memory limited)

Also, I suspect that MySQL (along with all other relational dbs I've used) 
is really shocking at dealing with massive IN clauses. It might well be 
worth with segments just getting segments where any of their nodes ever 
have been within the bounding box. Should be a lot quicker for the DB to 
filter from an in memory list of IDs, rather than parse a giant CSV string 
into such a list.

Nick




More information about the talk mailing list