[OSM-dev] strange Osmosis/XML/...? problem yesterday

[Frederik Ramm]

Hi,

    our automated job yesterday aborted with an "out of memory" 
condition in Osmosis. We traced this back to a change made to the node 
for Madrid (148332300) where someone added "name:got" with a lot of 
strange characters. For some reason, any time these characters pass 
through Osmosis, the size increases by a factor of four or so.

I have created a simple test case replicating this:

$ ls -l test.osm test.osc
-rw-r--r-- 1 fred fred 391 Aug 14 12:31 test.osc
-rw-r--r-- 1 fred fred 209 Aug 14 12:26 test.osm

$ osmosis --rxc test.osc --rx test.osm --ac --wx result.osm
Aug 14, 2009 12:36:22 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Osmosis Version 0.31
Aug 14, 2009 12:36:23 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Preparing pipeline.
Aug 14, 2009 12:36:23 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Launching pipeline execution.
Aug 14, 2009 12:36:23 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline executing, waiting for completion.
Aug 14, 2009 12:36:23 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline complete.
Aug 14, 2009 12:36:23 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Total execution time: 270 milliseconds.

$ ls -l result.osm
-rw-r--r-- 1 fred fred 1109 Aug 14 12:36 result.osm

The result file should have been something like 400 bytes. This sounds 
trivial but in the original case where the .osc contained a large number 
of these characters, I suddenly had 2 MB of data in one tag.

I hope the attached zipfile containing above test.osm/test.osc makes it 
through, otherwise I'll post it somewhere.

Bye
Frederik

-------------- next part --------------
A non-text attachment was scrubbed...
Name: broken.zip
Type: application/zip
Size: 704 bytes
Desc: not available
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20090814/286b4c55/attachment.zip>