[OSM-dev] Unicode Errors On Insert

[Brett Henderson]

I'm having trouble inserting non-ASCII data into an OSM MySQL schema. I 
think the characters are legal. The insert statement is attached, I've 
made it an attachment in case of email conversion errors.

<cid:part1.08050905.02030807 at bretth.com>I have two MySQL databases, one 
on Linux, the other on Windows. Linux is configured with the latin1 
character set, Windows with utf8.

The "status" command on the Linux db returns this info:
Server version: 5.0.27
Protocol version: 10
Connection: Localhost via UNIX socket
Server characterset: latin1
Db characterset: latin1
Client characterset: latin1
Conn. characterset: latin1

"status" on the window db returns this info:
Server version: 5.0.45-community-nt MySQL Community Edition (GPL)
Protocol version: 10
Connection: localhost via TCP/IP
Server characterset: utf8
Db characterset: utf8
Client characterset: utf8
Conn. characterset: utf8

Inserting into the Linux db succeeds, but I appear to be losing data. 
Extended characters are replaced with "?".
"name=Sta?e?;place=village;created_by=JOSM"

Inserting into the Windows db fails with the following error message.
Incorrect string value: '\xC5\x99e\xC4\x8D;...' for column 'tags' at row 1

The data in question is:
"name=Stařeč;place=village;created_by=JOSM"
(check the attachment if this doesn't show up in email).

Does anybody have any idea how the db should be configured? I assume 
that utf8 is preferred, but if so why is this insert failing?

-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: failed_insert.txt
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20070725/feafdc95/attachment.txt>