[osmosis-dev] Error while applying updates to planet.osm

Wed Jun 23 20:06:06 BST 2010

I recently downloaded the planet-100618.osm.bz2 file from one of the OSM
planet mirrors.
I also downloaded the state file with contents:
#Thu Jun 17 21:02:07 UTC 2010
sequenceNumber=5039
txnMaxQueried=0
timestamp=2010-06-17T21\:00\:00Z
txnReadyList=
txnMax=0
txnActiveList=

I configuring my repository ( see
http://wiki.openstreetmap.org/wiki/Using_planet.osm ).

Next, I ran the commands below to get my updates and simplify them:
osmosis --rri workingDirectory=. --wxc update.osm.gz
gzip -d -c update.osm.gz | /usr/local/osmosis/bin/osmosis
--read-xml-change file=/dev/stdin --simplify-change --write-xml-change
file=- | gzip -9 -c> update.unique.osm.gz

Finally, I attempted to apply these changes to my planet.osm file:
bzcat planet-100618.osm.bz2 | /usr/local/osmosis/bin/osmosis
--read-xml-change file="update.unique.osm.gz" --read-xml file=/dev/stdin
--apply-change --write-xml file=- | bzip2 -c > planet.osm.bz2

After what seemed like an eternity I got the following exception:

SEVERE: Thread for task 1-read-xml-change failed
org.openstreetmap.osmosis.core.OsmosisRuntimeException: An output error
has occurred, aborting.
        at
org.openstreetmap.osmosis.core.store.DataPostbox.checkForOutputErrors(DataPostbox.java:76)
        at
org.openstreetmap.osmosis.core.store.DataPostbox.populateCentralQueue(DataPostbox.java:132)
        at
org.openstreetmap.osmosis.core.store.DataPostbox.put(DataPostbox.java:182)
        at
org.openstreetmap.osmosis.core.merge.v0_6.impl.DataPostboxChangeSink.process(DataPostboxChangeSink.java:34)
        at
org.openstreetmap.osmosis.core.merge.v0_6.impl.SortedDeltaChangePipeValidator.process(SortedDeltaChangePipeValidator.java:63)
        at
org.openstreetmap.osmosis.core.xml.v0_6.impl.ChangeSourceElementProcessor$ChangeSinkAdapter.process(ChangeSourceElementProcessor.java:134)
        at
org.openstreetmap.osmosis.core.xml.v0_6.impl.NodeElementProcessor.end(NodeElementProcessor.java:117)
        at
org.openstreetmap.osmosis.core.xml.v0_6.impl.OsmChangeHandler.endElement(OsmChangeHandler.java:94)
        at org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown
Source)
        at
org.apache.xerces.parsers.AbstractXMLDocumentParser.emptyElement(Unknown
Source)
        at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanStartElement(Unknown
Source)
        at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown
Source)
        at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown
Source)
        at org.apache.xerces.parsers.XML11Configuration.parse(Unknown
Source)
        at org.apache.xerces.parsers.XML11Configuration.parse(Unknown
Source)
        at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
        at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown
Source)
        at
org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source)
        at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source)
        at javax.xml.parsers.SAXParser.parse(SAXParser.java:195)
        at
org.openstreetmap.osmosis.core.xml.v0_6.XmlChangeReader.run(XmlChangeReader.java:107)
        at java.lang.Thread.run(Thread.java:636)
23-Jun-2010 1:46:01 PM
org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager
waitForCompletion
SEVERE: Thread for task 2-read-xml failed
org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to parse
xml file /dev/stdin.  publicId=(null), systemId=(null),
lineNumber=116829631, columnNumber=20.
        at
org.openstreetmap.osmosis.core.xml.v0_6.XmlReader.run(XmlReader.java:113)
        at java.lang.Thread.run(Thread.java:636)
Caused by: org.xml.sax.SAXParseException: The value of attribute "id"
associated with an element type "node" must not contain the '<' character.
        at
org.apache.xerces.util.ErrorHandlerWrapper.createSAXParseException(Unknown
Source)
        at org.apache.xerces.util.ErrorHandlerWrapper.fatalError(Unknown
Source)
        at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown
Source)
        at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown
Source)
        at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown
Source)
        at org.apache.xerces.impl.XMLScanner.reportFatalError(Unknown
Source)
        at org.apache.xerces.impl.XMLScanner.scanAttributeValue(Unknown
Source)
        at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanAttribute(Unknown
Source)
        at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanStartElement(Unknown
Source)
        at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown
Source)
        at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown
Source)
        at org.apache.xerces.parsers.XML11Configuration.parse(Unknown
Source)
        at org.apache.xerces.parsers.XML11Configuration.parse(Unknown
Source)
        at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
        at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown
Source)
        at
org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source)
        at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source)
        at javax.xml.parsers.SAXParser.parse(SAXParser.java:195)
        at
org.openstreetmap.osmosis.core.xml.v0_6.XmlReader.run(XmlReader.java:108)
        ... 1 more
23-Jun-2010 1:46:01 PM
org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager
waitForCompletion
SEVERE: Thread for task 3-apply-change failed
org.openstreetmap.osmosis.core.OsmosisRuntimeException: An input error has
occurred, aborting.
        at
org.openstreetmap.osmosis.core.store.DataPostbox.checkForInputErrors(DataPostbox.java:88)
        at
org.openstreetmap.osmosis.core.store.DataPostbox.consumeCentralQueue(DataPostbox.java:158)
        at
org.openstreetmap.osmosis.core.store.DataPostbox.hasNext(DataPostbox.java:235)
        at
org.openstreetmap.osmosis.core.change.v0_6.ChangeApplier.run(ChangeApplier.java:175)
        at java.lang.Thread.run(Thread.java:636)
23-Jun-2010 1:46:01 PM org.openstreetmap.osmosis.core.Osmosis main
SEVERE: Execution aborted.
org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks
failed.
        at
org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146)
        at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:85)
        at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:30)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:616)
        at
org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:329)
        at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:239)
        at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
        at
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
        at org.codehaus.classworlds.Launcher.main(Launcher.java:31)

I also tried to extract my planet.osm and got the following error:
bunzip2 -k planet-100618.osm.bz2

bunzip2: Data integrity error when decompressing.
        Input file = planet-100618.osm.bz2, output file =
planet-100618.osm

It is possible that the compressed file(s) have become corrupted.
You can use the -tvv option to test integrity of such files.

You can use the `bzip2recover' program to attempt to recover
data from undamaged sections of corrupted files.

bunzip2: Deleting output file planet-100618.osm, if it exists.

Does anyone know what's going on?  It looks like the planet.osm file has
an issue (ie an id node with < in the value).  Perhaps I'm just going
something wrong here?  This is the second planet.osm file I've downloaded
that hasn't worked out for me.

Thanks!
Tyler