[OSM-dev] OSMOSIS-Dataconverting APi0.5 -> Api0.6 problem

Sabine.Teile at gmx.de Sabine.Teile at gmx.de
Thu Sep 10 09:59:59 BST 2009


Hello,

one year ago I've set up an OSM-Server with API 0.5. Now we've switched to a new Debian-Server with API 0.6 and postgres-DB. To import the old data from the old API-05-Server into the new API06-Server I've tried the steps below-mentioned. During the import osmosis is terminating with the following error: 
"Unable to bulk insert node tags into the database."
.......
Caused by: org.postgresql.util.PSQLException: ERROR: value too long for type character varying(255)
...

1) Data export on the "old" Server (Api 0.5. mysql-DB, osmosis 0.29):
osmosis --read-mysql  database="openstreetmap" user="openstreetmap" password="xyz" validateSchemaVersion=no  --wx Data_API05.osm.bz2


2) Dataimport on the "new" Debian-Server (Api 0.6 postgres-DB, osmosis 0.31.2):
a) osmosis  --read-xml-0.5 Data_API05.osm.bz2 --migrate --write-xml-0.6 Data_API06.osm.bz2

b) osmosis --read-xml-0.6 file="Data_API06.osm.bz2" --write-apidb-0.6 populateCurrentTables=yes host="localhost" database="openstreetmap" user="openstreetmap" password="xyz" validateSchemaVersion=no


It's possible to import a complete planet-file without any errors - hmmm. 

I've spent two days to find a solution and tried a lot of data converting. Not sure what I'm doing wrong. Has anybody an idea?

Thanks !!!
Sabine

-------------------------------------------



osmosis -v --read-xml-0.6 file="InputFile_API06.osm.bz2" --write-apidb-0.6 populateCurrentTables=yes host="localhost" database="openstreetmap" user="openstreetmap" password="xyz" validateSchemaVersion=no
Sep 10, 2009 9:49:58 AM org.openstreetmap.osmosis.core.Osmosis run
INFO: Osmosis Version 0.31.2
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.TaskRegistrar loadJPFPlugins
FINE: Searching for JPF plugins.
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.TaskRegistrar loadJPFPlugins
FINE: Registering the core plugin.
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.TaskRegistrar loadJPFPlugins
FINE: Registering the extension plugins.
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.Osmosis run
INFO: Preparing pipeline.
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.pipeline.common.Pipeline prepare
FINE: Building tasks.
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "1-read-xml-0.6"
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "2-write-apidb-0.6"
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.pipeline.common.Pipeline prepare
FINE: Connecting tasks.
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "1-read-xml-0.6" produced unnamed pipe stored at level 1 in the default pipe stack.
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "1-read-xml-0.6"
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "2-write-apidb-0.6" consumed unnamed pipe stored at level 1 in the default pipe stack.
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "2-write-apidb-0.6"
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.Osmosis run
INFO: Launching pipeline execution.
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager execute
FINE: Launching task 1-read-xml-0.6 in a new thread.
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 2-write-apidb-0.6 is passive, no execution required.
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline executing, waiting for completion.
Sep 10, 2009 9:49:59 AM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager waitForCompletion
FINE: Waiting for task 1-read-xml-0.6 to complete.
Sep 10, 2009 9:52:01 AM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager waitForCompletion
SEVERE: Thread for task 1-read-xml-0.6 failed
org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to bulk insert node tags into the database.
        at org.openstreetmap.osmosis.core.apidb.v0_6.ApidbWriter.flushNodeTags(ApidbWriter.java:617)
        at org.openstreetmap.osmosis.core.apidb.v0_6.ApidbWriter.addNodeTags(ApidbWriter.java:1092)
        at org.openstreetmap.osmosis.core.apidb.v0_6.ApidbWriter.flushNodes(ApidbWriter.java:573)
        at org.openstreetmap.osmosis.core.apidb.v0_6.ApidbWriter.process(ApidbWriter.java:1078)
        at org.openstreetmap.osmosis.core.container.v0_6.NodeContainer.process(NodeContainer.java:58)
        at org.openstreetmap.osmosis.core.apidb.v0_6.ApidbWriter.process(ApidbWriter.java:1052)
        at org.openstreetmap.osmosis.core.xml.v0_6.impl.NodeElementProcessor.end(NodeElementProcessor.java:109)
        at org.openstreetmap.osmosis.core.xml.v0_6.impl.OsmHandler.endElement(OsmHandler.java:108)
        at org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown Source)
        at org.apache.xerces.parsers.AbstractXMLDocumentParser.emptyElement(Unknown Source)
        at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanStartElement(Unknown Source)
        at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown Source)
        at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source)
        at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
        at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
        at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
        at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source)
        at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source)
        at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source)
        at javax.xml.parsers.SAXParser.parse(Unknown Source)
        at org.openstreetmap.osmosis.core.xml.v0_6.XmlReader.run(XmlReader.java:108)
        at java.lang.Thread.run(Thread.java:636)
Caused by: org.postgresql.util.PSQLException: ERROR: value too long for type character varying(255)
        at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1592)
        at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1327)
        at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:192)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:451)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:350)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:304)
        at org.openstreetmap.osmosis.core.apidb.v0_6.ApidbWriter.flushNodeTags(ApidbWriter.java:615)
        ... 21 more
Sep 10, 2009 9:52:01 AM org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager waitForCompletion
FINE: Task 2-write-apidb-0.6 is passive, no completion wait required.
Sep 10, 2009 9:52:01 AM org.openstreetmap.osmosis.core.Osmosis main
SEVERE: Execution aborted.
org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks failed.
        at org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146)
        at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:85)
        at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:30)
-- 
GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT!
Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01




More information about the dev mailing list