[OSM-dev] improving TIGER-to-OSM memory usage/performance

Dave Hansen dave at sr71.net
Sun Sep 16 20:43:35 BST 2007


On Sat, 2007-09-15 at 15:09 -0400, Nick Galbreath wrote:
> Hi everyone,
> 
> This is my first post to dev.
> 
> Recently I've been working on speeding up USA TIGER data conversion to
> OSM format.  I was able to take Dave Hansen's code
> (http://wiki.openstreetmap.org/index.php/TIGER) and run it on my home
> Mac, with minimal issues.  nice!

Hi Nick,

Thanks for looking into this so deeply.  Your version of tiger.rb
definitely runs faster than what we have now, so that's a great
improvement.

But, I'm wondering where all of the memory savings that you're seeing
come from.  I just tested one county for now (Lincoln, OR), and the old
version of tiger.rb used ~95MB of memory.  Your version used ~89MB.

What counties were you testing with, and what were the actual changes in
sizes that you were seeing?

I've also tweaked the ruby scripts as I've gone along so I wonder if
what we have are slightly different.  I know I've improved memory usage
over time.

-- Dave





More information about the dev mailing list