[Tilesathome] Rendering of non-Latin names

[Florian Lohoff]

On Fri, Sep 05, 2008 at 02:29:28PM +0300, Socrates Alichanides wrote:
> Subject: [Tilesathome] Rendering of non-Latin names
> 
> This is my first post so please be gentle :)
> 
> On Tuesday I rendered the following tile in xy mode:
> 
> http://tah.openstreetmap.org/Browse/details/tile/12/2309/1541/
> 
> When the process finished I noticed that all street names that are
> written in Greek were rendered with ???? (question marks), while those
> still in Latin were being rendered correctly.
> Thinking this was some fault of my system I requested a rerender,
> handled by jth, but the results were the same.
> 
> So I thought 'maybe some temporary problem',so I waited till yesterday 
> and requested another rerender to no avail. By the way when mapnik 
> render the same tile it rendered correctly.
> 
> Anybody have any ideas what's wrong?

Yep - its probably my fault - The investigation is ongoing. I wrote ROMA
the read-only-map-api which is the fallback when the API is overloaded.
ROMA currently handles utf-8 correct but some names which are utf-8 were
changed to ???? by osmosis while importing into the database. This has
been discovered with hebrew names. The interesting point is that not all
utf-8 has been corrupted by osmosis import. I had a look at Minsk and
all the kyrillic names were okay.

Currently i have a new import running on a second database (for ~48h),
this time a postgresql with correct utf-8 set charset. So hopefully this
will help. I'll change ROMA to use the postgresql (needs some tweaking
of the select statements) when the import is done.

Currently the database is building the geospatial index which it is
doing for 24h now.

So yes - your bug is known and a real problem - i am working on fixing
this ASAP but it might be that osmosis is at fault and then i'll
probably be the wrong to fix it (i dislike java).

Flo
-- 
Florian Lohoff                  flo at rfc822.org             +49-171-2280134
	Those who would give up a little freedom to get a little 
          security shall soon have neither - Benjamin Franklin
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 189 bytes
Desc: Digital signature
URL: <http://lists.openstreetmap.org/pipermail/tilesathome/attachments/20080905/5609e5b4/attachment.pgp>