[OSM-dev] Taginfo (tagstats) data processing error

[Martijn van Exel]

I am pretty sure it has something to do with the data bounds not being set to integers. I tried with float boundaries and it crashed. I tried with integer boundaries and it ran just fine. I will try and provide more debugging output later.
-- 
Martijn van Exel

On Apr 16, 2013, at 10:28 AM, Jochen Topf <jochen at remote.org> wrote:

> Hi!
> 
> Please try recompiling tagstats with debugging (-g) and with/without
> optimizations (-O3) (see beginning of Makefile) to see whether that makes a
> difference. If it still dumps core the backtrace from the debugging version
> might help.
> 
> You can also try with a different data file. I don't think it is related to the
> data because there shouldn't be anything in the US file thats not in the planet
> file and that works fine. But checking it doesn't hurt.
> 
> Jochen
> 
> On Tue, Apr 16, 2013 at 09:47:41AM -0600, Martijn van Exel wrote:
>> Date: Tue, 16 Apr 2013 09:47:41 -0600
>> From: Martijn van Exel <m at rtijn.org>
>> To: Jochen Topf <jochen at remote.org>
>> Cc: "dev at openstreetmap.org" <dev at openstreetmap.org>
>> Subject: Re: [OSM-dev] Taginfo (tagstats) data processing error
>> 
>> On Apr 16, 2013, at 8:02 AM, Jochen Topf <jochen at remote.org> wrote:
>> 
>>> On Tue, Apr 16, 2013 at 07:53:51AM -0600, Martijn van Exel wrote:
>>>> This is on a m3.2xlarge EC2 instance.
>>>> Any idea what is the matter here?
>>> 
>>> Can you provide a stack trace?
>>> 
>>> With something like this:
>>>   ulimit -c unlimited
>>>   run the update script
>>>   gdb core tagstats
>>>> bt
>> 
>> Found it, it was in /osm/taginfo/sources/db
>> 
>> Here's backtrace output:
>> 
>> Core was generated by `./tagstats --tags /osm/taginfo_data//db/interesting_tags.lst --relation-types /'.
>> Program terminated with signal 6, Aborted.
>> #0  0x00007f4b243b2425 in raise () from /lib/x86_64-linux-gnu/libc.so.6
>> (gdb) bt
>> #0  0x00007f4b243b2425 in raise () from /lib/x86_64-linux-gnu/libc.so.6
>> #1  0x00007f4b243b5b8b in abort () from /lib/x86_64-linux-gnu/libc.so.6
>> #2  0x00007f4b243ab0ee in ?? () from /lib/x86_64-linux-gnu/libc.so.6
>> #3  0x00007f4b243ab192 in __assert_fail () from /lib/x86_64-linux-gnu/libc.so.6
>> #4  0x00000000004107de in google::sparsetable<unsigned short, (unsigned short)48, google::libc_allocator_with_realloc<unsigned short> >::get(unsigned long) const ()
>> #5  0x0000000000422154 in TagStatsHandler::collect_tag_stats(Osmium::OSM::Object const&) ()
>> #6  0x0000000000426ac3 in void Osmium::Input::PBF<TagStatsHandler>::parse_way_group<void (TagStatsHandler::*)(boost::shared_ptr<Osmium::OSM::Way const> const&)>(OSMPBF::PrimitiveGroup const&, OSMPBF::StringTable const&, void (TagStatsHandler::*)(boost::shared_ptr<Osmium::OSM::Way const> const&)) ()
>> #7  0x0000000000427d42 in Osmium::Input::PBF<TagStatsHandler>::parse() ()
>> #8  0x000000000040ef97 in void Osmium::Input::read<TagStatsHandler>(Osmium::OSMFile const&, TagStatsHandler&) ()
>> #9  0x0000000000405f6a in main ()
>> 
>> Let me know if you need more than that.
>> 
>> Martijn
> 
> -- 
> Jochen Topf  jochen at remote.org  http://www.remote.org/jochen/  +49-721-388298