[OSM-dev] osmosis problem

AirWalker air at freemail.hu
Thu Oct 15 18:33:18 BST 2009


Dear List,

I'd like to upload osm data (hungary.osm.bz2 form geofabrik) to a
database using osmosis.
If I try pgsql, I get the following error:

$ osmosis-0.31.2/bin/osmosis --read-xml file="hungary.osm" --write-pgsql
database="osm" user="osm" password="xxx"
2009.10.15. 18:51:25 org.openstreetmap.osmosis.core.Osmosis run
INFO: Osmosis Version 0.31.2
2009.10.15. 18:51:26 org.openstreetmap.osmosis.core.Osmosis run
INFO: Preparing pipeline.
2009.10.15. 18:51:26 org.openstreetmap.osmosis.core.Osmosis run
INFO: Launching pipeline execution.
2009.10.15. 18:51:26 org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline executing, waiting for completion.
2009.10.15. 18:51:28
org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager
waitForCompletion
SEVERE: Thread for task 1-read-xml failed
org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to bulk
insert nodes into the database.
        at
org.openstreetmap.osmosis.core.pgsql.v0_6.PostgreSqlWriter.flushNodes(PostgreSqlWriter.java:371)
        at
org.openstreetmap.osmosis.core.pgsql.v0_6.PostgreSqlWriter.process(PostgreSqlWriter.java:930)
        at
org.openstreetmap.osmosis.core.container.v0_6.NodeContainer.process(NodeContainer.java:58)
        at
org.openstreetmap.osmosis.core.pgsql.v0_6.PostgreSqlWriter.process(PostgreSqlWriter.java:907)
        at
org.openstreetmap.osmosis.core.xml.v0_6.impl.NodeElementProcessor.end(NodeElementProcessor.java:109)
        at
org.openstreetmap.osmosis.core.xml.v0_6.impl.OsmHandler.endElement(OsmHandler.java:108)
        at
org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown Source)
        at
org.apache.xerces.parsers.AbstractXMLDocumentParser.emptyElement(Unknown
Source)
        at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanStartElement(Unknown 

Source)
        at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown 

Source)
        at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown
Source)
        at org.apache.xerces.parsers.XML11Configuration.parse(Unknown
Source)
        at org.apache.xerces.parsers.XML11Configuration.parse(Unknown
Source)
        at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
        at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source)
        at
org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source)
        at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source)
        at javax.xml.parsers.SAXParser.parse(SAXParser.java:198)
        at
org.openstreetmap.osmosis.core.xml.v0_6.XmlReader.run(XmlReader.java:108)
        at java.lang.Thread.run(Thread.java:619)
Caused by: org.postgresql.util.PSQLException: ERROR: syntax error at or
near ","
        at
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1592)
        at
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1327)
        at
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:192)
        at
org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:451)
        at
org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:350)
        at
org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:304)
        at
org.openstreetmap.osmosis.core.pgsql.v0_6.PostgreSqlWriter.flushNodes(PostgreSqlWriter.java:369)
        ... 19 more
2009.10.15. 18:51:28 org.openstreetmap.osmosis.core.Osmosis main
SEVERE: Execution aborted.
org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more
tasks failed.
        at
org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146)
        at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:85)
        at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:30)

I think the relevant lines are:
- org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to bulk
insert nodes into the database.
- Caused by: org.postgresql.util.PSQLException: ERROR: syntax error at
or near ","

So I thought the hungary.osm is corrupted, but I get the same result
with other datasets as well.
Then I tried mysql:
$ osmosis-0.31.2/bin/osmosis --read-xml file="hungary.osm" --write-apidb
dbType="mysql" database="api06_test" user="osm" password="OpenStreetMap"
validateSchemaVersion=no

After 5+ minutes of running I get this error message:
2009.10.15. 19:04:30 org.openstreetmap.osmosis.core.Osmosis run
INFO: Osmosis Version 0.31.2
2009.10.15. 19:04:32 org.openstreetmap.osmosis.core.Osmosis run
INFO: Preparing pipeline.
2009.10.15. 19:04:32 org.openstreetmap.osmosis.core.Osmosis run
INFO: Launching pipeline execution.
2009.10.15. 19:04:32 org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline executing, waiting for completion.
date
2009.10.15. 19:09:23
org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager
waitForCompletion
SEVERE: Thread for task 1-read-xml failed
org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to bulk
insert nodes into the database.
        at
org.openstreetmap.osmosis.core.apidb.v0_6.ApidbWriter.flushNodes(ApidbWriter.java:569)
        at
org.openstreetmap.osmosis.core.apidb.v0_6.ApidbWriter.process(ApidbWriter.java:1078)
        at
org.openstreetmap.osmosis.core.container.v0_6.NodeContainer.process(NodeContainer.java:58)
        at
org.openstreetmap.osmosis.core.apidb.v0_6.ApidbWriter.process(ApidbWriter.java:1052)
        at
org.openstreetmap.osmosis.core.xml.v0_6.impl.NodeElementProcessor.end(NodeElementProcessor.java:109)
        at
org.openstreetmap.osmosis.core.xml.v0_6.impl.OsmHandler.endElement(OsmHandler.java:108)
        at
org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown Source)
        at
org.apache.xerces.parsers.AbstractXMLDocumentParser.emptyElement(Unknown
Source)
        at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanStartElement(Unknown 

Source)
        at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown 

Source)
        at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown
Source)
        at org.apache.xerces.parsers.XML11Configuration.parse(Unknown
Source)
        at org.apache.xerces.parsers.XML11Configuration.parse(Unknown
Source)
        at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
        at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source)
        at
org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source)
        at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source)
        at javax.xml.parsers.SAXParser.parse(SAXParser.java:198)
        at
org.openstreetmap.osmosis.core.xml.v0_6.XmlReader.run(XmlReader.java:108)
        at java.lang.Thread.run(Thread.java:619)
Caused by: java.sql.SQLException: The table 'nodes' is full
        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1055)
        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:956)
        at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3491)
        at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3423)
        at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1936)
        at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2060)
        at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2542)
        at
com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1734)
        at
com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2019)
        at
com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:1937)
        at
com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:1922)
        at
org.openstreetmap.osmosis.core.apidb.v0_6.ApidbWriter.flushNodes(ApidbWriter.java:567)
        ... 19 more
2009.10.15. 19:09:23 org.openstreetmap.osmosis.core.Osmosis main
SEVERE: Execution aborted.
org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more
tasks failed.
        at
org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146)
        at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:85)
        at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:30)


I've altered the table to allow 1000000000 rows (ALTER TABLE nodes
MAX_ROWS=1000000000), but this didn't helped either.

Could someone help me please? It would be very much appreciated!

Thanks in advance,
air






More information about the dev mailing list