[osmosis-dev] Incorrect string value: '\xF0\x90\x8D\x83\xF0\x90...' for column 'v' at row 6

[Simon Nuttall]

Until about 2 weeks ago the following osmosis call had been working just
fine, but it has now started giving me the error message farther below.

I'm guessing that it is something to do with the character set, but I have
got mysql/my.cnf set up to use utf8:

[mysqld]
character_set_server=utf8
collation_server=utf8_unicode_ci

[mysql]
default-character-set=utf8


How can I debug / fix this?

osmosis -v 100 --read-pbf data/osm/downloads/europe/british_isles.osm.pbf
 --tag-filter accept-ways highway=* aerialway=* route=ferry
man_made=pier,jetty --tag-filter reject-ways
highway=motorway,bus_guideway,construction --read-pbf
data/osm/downloads/europe/denmark.osm.pbf  --tag-filter accept-ways
highway=* aerialway=* route=ferry man_made=pier,jetty --tag-filter
reject-ways highway=motorway,bus_guideway,construction --merge --read-pbf
data/osm/downloads/europe/estonia.osm.pbf  --tag-filter accept-ways
highway=* aerialway=* route=ferry man_made=pier,jetty --tag-filter
reject-ways highway=motorway,bus_guideway,construction --merge --read-pbf
data/osm/downloads/europe/czech_republic.osm.pbf  --tag-filter accept-ways
highway=* aerialway=* route=ferry man_made=pier,jetty --tag-filter
reject-ways highway=motorway,bus_guideway,construction --bounding-polygon
file="import/fz_prague.txt" --merge --read-pbf
data/osm/downloads/europe/croatia.osm.pbf  --tag-filter accept-ways
highway=* aerialway=* route=ferry man_made=pier,jetty --tag-filter
reject-ways highway=motorway,bus_guideway,construction --merge --read-pbf
data/osm/downloads/europe/lithuania.osm.pbf  --tag-filter accept-ways
highway=* aerialway=* route=ferry man_made=pier,jetty --tag-filter
reject-ways highway=motorway,bus_guideway,construction --merge --read-pbf
data/osm/downloads/europe/iceland.osm.pbf  --tag-filter accept-ways
highway=* aerialway=* route=ferry man_made=pier,jetty --tag-filter
reject-ways highway=motorway,bus_guideway,construction --merge --read-pbf
data/osm/downloads/europe/norway.osm.pbf  --tag-filter accept-ways
highway=* aerialway=* route=ferry man_made=pier,jetty --tag-filter
reject-ways highway=motorway,bus_guideway,construction --merge --read-pbf
data/osm/downloads/europe/sweden.osm.pbf  --tag-filter accept-ways
highway=* aerialway=* route=ferry man_made=pier,jetty --tag-filter
reject-ways highway=motorway,bus_guideway,construction --merge --read-pbf
data/osm/downloads/europe/netherlands.osm.pbf  --tag-filter accept-ways
highway=* aerialway=* route=ferry man_made=pier,jetty --tag-filter
reject-ways highway=motorway,bus_guideway,construction --merge --read-pbf
data/osm/downloads/europe/belgium.osm.pbf  --tag-filter accept-ways
highway=* aerialway=* route=ferry man_made=pier,jetty --tag-filter
reject-ways highway=motorway,bus_guideway,construction --merge --read-pbf
data/osm/downloads/europe/luxembourg.osm.pbf  --tag-filter accept-ways
highway=* aerialway=* route=ferry man_made=pier,jetty --tag-filter
reject-ways highway=motorway,bus_guideway,construction --merge --read-pbf
data/osm/downloads/europe/switzerland.osm.pbf  --tag-filter accept-ways
highway=* aerialway=* route=ferry man_made=pier,jetty --tag-filter
reject-ways highway=motorway,bus_guideway,construction --bounding-polygon
file="import/fz_bern.txt" --merge  --buffer --write-apidb dbType=mysql
populateCurrentTables=no host=localhost database=planetExtractOSM121105
user=import password=*** validateSchemaVersion=no


05-Nov-2012 21:45:26 org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline executing, waiting for completion.
05-Nov-2012 21:45:26
org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager
waitForCompletion
FINE: Waiting for task 1-read-pbf to complete.
05-Nov-2012 21:50:49
org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager
waitForCompletion
SEVERE: Thread for task 1-read-pbf failed
org.openstreetmap.osmosis.core.OsmosisRuntimeException: An output error has
occurred, aborting.
.
.
.
05-Nov-2012 21:50:49
org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager
waitForCompletion
FINE: Waiting for task 54-buffer to complete.
05-Nov-2012 21:50:49
org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager
waitForCompletion
SEVERE: Thread for task 54-buffer failed
org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to bulk
insert node tags into the database.
        at
org.openstreetmap.osmosis.apidb.v0_6.ApidbWriter.flushNodeTags(ApidbWriter.java:629)
        at
org.openstreetmap.osmosis.apidb.v0_6.ApidbWriter.addNodeTags(ApidbWriter.java:1126)
        at
org.openstreetmap.osmosis.apidb.v0_6.ApidbWriter.flushNodes(ApidbWriter.java:585)
        at
org.openstreetmap.osmosis.apidb.v0_6.ApidbWriter.process(ApidbWriter.java:1112)
        at
org.openstreetmap.osmosis.core.container.v0_6.NodeContainer.process(NodeContainer.java:58)
        at
org.openstreetmap.osmosis.apidb.v0_6.ApidbWriter.process(ApidbWriter.java:1086)
        at
org.openstreetmap.osmosis.core.buffer.v0_6.EntityBuffer.run(EntityBuffer.java:74)
        at java.lang.Thread.run(Thread.java:636)
Caused by: java.sql.SQLException: Incorrect string value:
'\xF0\x90\x8D\x83\xF0\x90...' for column 'v' at row 6
...

Simon
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/osmosis-dev/attachments/20121105/c1d202b7/attachment.html>