[OSM-dev] osmium trouble

[Jochen Topf]

Hi!

I just pushed a fix for the memory leak. Please check whether it fixed your
problems.

Jochen

On Sun, Nov 20, 2011 at 01:01:55PM +0100, Hermann Peifer wrote:
> Date: Sun, 20 Nov 2011 13:01:55 +0100
> From: Hermann Peifer <peifer at gmx.eu>
> To: ThomasB <toba0211 at yahoo.de>
> Cc: dev at openstreetmap.org
> Subject: Re: [OSM-dev] osmium trouble
> 
> On 19/11/2011 21:58, Hermann Peifer wrote:
> >On 19/11/2011 20:06, ThomasB wrote:
> >>Hi there,
> >>
> >>I get the following error when using osmium
> >>/thomas at suncobalt:~/osmium/osmjs/js$ ~/osmium/osmjs/osmjs -j count.js
> >>~/osmlength/pbffiles/germany.osm.pbf
> >>Start!
> >>
> >>#
> >># Fatal error in CALL_AND_RETRY_2
> >># Allocation failed - process out of memory
> >>#
> >>/
> >>The process used up to 2.5GB RAM and although there is still 9.5GB
> >>physical
> >>RAM available it stops.
> >>osmjs and countjs are unmodified as they came from git.
> >>
> >>Smaller files/extracts work without any issues
> >>
> >
> >Same here on a Debian-Linux system with 8 GB RAM. Earlier today, things
> >were working fine when I was using an older version of osmjs (from
> >around mid-September). In the afternoon, I updated all dependencies,
> >refreshed from github and re-compiled osmjs. Now I can't process
> >germany.osm.pbf anymore: after about 1:30 min., the process aborts with
> >the above error.
> >
> >The problem doesn't seem to be related to the type of node location
> >store, it even occurs with: -l none
> >
> 
> As a workaround, I rolled my local git repo back to commit [1] from
> 15 October, where osmjs still works fine. The changes in [2] are
> causing the memory allocation trouble with larger .pbf files.
> 
> Hermann
> 
> [1] https://github.com/joto/osmium/commit/61de862b54ffd879034c6f371df99182480fd613
> 
> [2] https://github.com/joto/osmium/commit/17604decdd2f26d9fc831cc3c2412a8ca97dc2b0
> 
> _______________________________________________
> dev mailing list
> dev at openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
> 

-- 
Jochen Topf  jochen at remote.org  http://www.remote.org/jochen/  +49-721-388298