[OSM-dev] improving TIGER-to-OSM memory usage/performance
Dave Hansen
dave at sr71.net
Sun Sep 16 20:43:35 BST 2007
On Sat, 2007-09-15 at 15:09 -0400, Nick Galbreath wrote:
> Hi everyone,
>
> This is my first post to dev.
>
> Recently I've been working on speeding up USA TIGER data conversion to
> OSM format. I was able to take Dave Hansen's code
> (http://wiki.openstreetmap.org/index.php/TIGER) and run it on my home
> Mac, with minimal issues. nice!
Hi Nick,
Thanks for looking into this so deeply. Your version of tiger.rb
definitely runs faster than what we have now, so that's a great
improvement.
But, I'm wondering where all of the memory savings that you're seeing
come from. I just tested one county for now (Lincoln, OR), and the old
version of tiger.rb used ~95MB of memory. Your version used ~89MB.
What counties were you testing with, and what were the actual changes in
sizes that you were seeing?
I've also tweaked the ruby scripts as I've gone along so I wonder if
what we have are slightly different. I know I've improved memory usage
over time.
-- Dave
More information about the dev
mailing list