[OSM-dev] planet.osm

[Nicola Ranaldo]

> I believe my UTF8sanitizer filters out bad UTF8:
> <www.lysator.liu.se/~jonass/UTF8sanitizer.c>. May be hard to use
> unless you are used to unix & C & and compiling.
>
> /Jonas

Ok it passed the expat parsing!
To import the entire file with no bounding-box reduction on a machine with  
low memory i used the db to lookup for existents node and segments.
This slows the import process. On a dualcore 3.0 ghz the import was about 18 
hours long on postgres. I think i can achieve better results with mysql, but 
the problem will be presented again while data continues to grow.
We should begin to think at a binary planet.osm too.
I'm just trying planetosm-to-db.sql too , top reports it's using 1.6Gb of ram!

	Niko