[OSM-dev] Taginfo (tagstats) data processing error

[Jochen Topf]

Hi!

Please try recompiling tagstats with debugging (-g) and with/without
optimizations (-O3) (see beginning of Makefile) to see whether that makes a
difference. If it still dumps core the backtrace from the debugging version
might help.

You can also try with a different data file. I don't think it is related to the
data because there shouldn't be anything in the US file thats not in the planet
file and that works fine. But checking it doesn't hurt.

Jochen

On Tue, Apr 16, 2013 at 09:47:41AM -0600, Martijn van Exel wrote:
> Date: Tue, 16 Apr 2013 09:47:41 -0600
> From: Martijn van Exel <m at rtijn.org>
> To: Jochen Topf <jochen at remote.org>
> Cc: "dev at openstreetmap.org" <dev at openstreetmap.org>
> Subject: Re: [OSM-dev] Taginfo (tagstats) data processing error
> 
> On Apr 16, 2013, at 8:02 AM, Jochen Topf <jochen at remote.org> wrote:
> 
> > On Tue, Apr 16, 2013 at 07:53:51AM -0600, Martijn van Exel wrote:
> >> This is on a m3.2xlarge EC2 instance.
> >> Any idea what is the matter here?
> > 
> > Can you provide a stack trace?
> > 
> > With something like this:
> >    ulimit -c unlimited
> >    run the update script
> >    gdb core tagstats
> >> bt
> 
> Found it, it was in /osm/taginfo/sources/db
> 
> Here's backtrace output:
> 
> Core was generated by `./tagstats --tags /osm/taginfo_data//db/interesting_tags.lst --relation-types /'.
> Program terminated with signal 6, Aborted.
> #0  0x00007f4b243b2425 in raise () from /lib/x86_64-linux-gnu/libc.so.6
> (gdb) bt
> #0  0x00007f4b243b2425 in raise () from /lib/x86_64-linux-gnu/libc.so.6
> #1  0x00007f4b243b5b8b in abort () from /lib/x86_64-linux-gnu/libc.so.6
> #2  0x00007f4b243ab0ee in ?? () from /lib/x86_64-linux-gnu/libc.so.6
> #3  0x00007f4b243ab192 in __assert_fail () from /lib/x86_64-linux-gnu/libc.so.6
> #4  0x00000000004107de in google::sparsetable<unsigned short, (unsigned short)48, google::libc_allocator_with_realloc<unsigned short> >::get(unsigned long) const ()
> #5  0x0000000000422154 in TagStatsHandler::collect_tag_stats(Osmium::OSM::Object const&) ()
> #6  0x0000000000426ac3 in void Osmium::Input::PBF<TagStatsHandler>::parse_way_group<void (TagStatsHandler::*)(boost::shared_ptr<Osmium::OSM::Way const> const&)>(OSMPBF::PrimitiveGroup const&, OSMPBF::StringTable const&, void (TagStatsHandler::*)(boost::shared_ptr<Osmium::OSM::Way const> const&)) ()
> #7  0x0000000000427d42 in Osmium::Input::PBF<TagStatsHandler>::parse() ()
> #8  0x000000000040ef97 in void Osmium::Input::read<TagStatsHandler>(Osmium::OSMFile const&, TagStatsHandler&) ()
> #9  0x0000000000405f6a in main ()
> 
> Let me know if you need more than that.
> 
> Martijn

-- 
Jochen Topf  jochen at remote.org  http://www.remote.org/jochen/  +49-721-388298