[osmosis-dev] Incorrect string value: '\xF0\x90\x8D\x83\xF0\x90...' for column 'v' at row 6

[Simon Nuttall]

On 9 November 2012 10:33, Brett Henderson <brett at bretth.com> wrote:
> On 8 November 2012 20:40, Simon Nuttall <info at cyclestreets.net> wrote:
>>
>> Regarding my initial request on this:
>>
>> http://lists.openstreetmap.org/pipermail/osmosis-dev/2012-November/001409.html
>>
>> I have fixed the problem by updating our debian server, which has
>> changed the MySQL version from 5.1.49-3-log  to 5.1.63-0+squeeze1-log.
>
>
> That's a great result.  I wasn't sure where to begin with this error.  It's
> been a while since I've had to tackle character set issues, I was hoping
> they'd gone forever :-)

We run the osmosis command daily with the long list of newly
downloaded extracts from geofabrik. Occasionally (probably about once
a month) it breaks with the same 'Incorrect string value' error.

When it broke the other day I tried splitting up the command into
smaller parts to isolate the problem to a specific extract. Reading
the pbfs in the command up to and including the Netherlands worked,
but when I ran it again including up to Belgium it broke. However
processing Belgium on its own did work.

I re-ran it the following day with fresh extracts and it worked fine.
So the issue is perhaps due to occasional data errors in the
downloaded extracts, rather than having a slightly out of date MySQL.