[OSM-dev] osmosis problem
Pallinger Péter
pallinger at dsd.sztaki.hu
Fri Oct 16 09:01:19 BST 2009
Interesting that you could import anything into mysql (which version?). I've got told
that mysql support was deprecated, and should use postgre instead. :)
For me, osmosis->postgre worked with
- postgre 8.3.8
- Osmosis 0.31
Maybe you could try this older version of osmosis.
You can also create a smaller osm file for testing using josm, that may be small enough
to fit into mysql.
I hope I helped,
PP
Ps.: Jó hogy vannak még magyarok itt. :)
AirWalker írta:
> Dear List,
>
> I'd like to upload osm data (hungary.osm.bz2 form geofabrik) to a
> database using osmosis.
> If I try pgsql, I get the following error:
>
> $ osmosis-0.31.2/bin/osmosis --read-xml file="hungary.osm" --write-pgsql
> database="osm" user="osm" password="xxx"
> 2009.10.15. 18:51:25 org.openstreetmap.osmosis.core.Osmosis run
> INFO: Osmosis Version 0.31.2
> 2009.10.15. 18:51:26 org.openstreetmap.osmosis.core.Osmosis run
> INFO: Preparing pipeline.
> 2009.10.15. 18:51:26 org.openstreetmap.osmosis.core.Osmosis run
> INFO: Launching pipeline execution.
> 2009.10.15. 18:51:26 org.openstreetmap.osmosis.core.Osmosis run
> INFO: Pipeline executing, waiting for completion.
> 2009.10.15. 18:51:28
> org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager
> waitForCompletion
> SEVERE: Thread for task 1-read-xml failed
> org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to bulk
> insert nodes into the database.
> at
> org.openstreetmap.osmosis.core.pgsql.v0_6.PostgreSqlWriter.flushNodes(PostgreSqlWriter.java:371)
> at
> org.openstreetmap.osmosis.core.pgsql.v0_6.PostgreSqlWriter.process(PostgreSqlWriter.java:930)
> at
> org.openstreetmap.osmosis.core.container.v0_6.NodeContainer.process(NodeContainer.java:58)
> at
> org.openstreetmap.osmosis.core.pgsql.v0_6.PostgreSqlWriter.process(PostgreSqlWriter.java:907)
> at
> org.openstreetmap.osmosis.core.xml.v0_6.impl.NodeElementProcessor.end(NodeElementProcessor.java:109)
> at
> org.openstreetmap.osmosis.core.xml.v0_6.impl.OsmHandler.endElement(OsmHandler.java:108)
> at
> org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown Source)
> at
> org.apache.xerces.parsers.AbstractXMLDocumentParser.emptyElement(Unknown
> Source)
> at
> org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanStartElement(Unknown
>
> Source)
> at
> org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown
>
> Source)
> at
> org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown
> Source)
> at org.apache.xerces.parsers.XML11Configuration.parse(Unknown
> Source)
> at org.apache.xerces.parsers.XML11Configuration.parse(Unknown
> Source)
> at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
> at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source)
> at
> org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source)
> at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source)
> at javax.xml.parsers.SAXParser.parse(SAXParser.java:198)
> at
> org.openstreetmap.osmosis.core.xml.v0_6.XmlReader.run(XmlReader.java:108)
> at java.lang.Thread.run(Thread.java:619)
> Caused by: org.postgresql.util.PSQLException: ERROR: syntax error at or
> near ","
> at
> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:1592)
> at
> org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1327)
> at
> org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:192)
> at
> org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:451)
> at
> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:350)
> at
> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:304)
> at
> org.openstreetmap.osmosis.core.pgsql.v0_6.PostgreSqlWriter.flushNodes(PostgreSqlWriter.java:369)
> ... 19 more
> 2009.10.15. 18:51:28 org.openstreetmap.osmosis.core.Osmosis main
> SEVERE: Execution aborted.
> org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more
> tasks failed.
> at
> org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146)
> at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:85)
> at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:30)
>
> I think the relevant lines are:
> - org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to bulk
> insert nodes into the database.
> - Caused by: org.postgresql.util.PSQLException: ERROR: syntax error at
> or near ","
>
> So I thought the hungary.osm is corrupted, but I get the same result
> with other datasets as well.
> Then I tried mysql:
> $ osmosis-0.31.2/bin/osmosis --read-xml file="hungary.osm" --write-apidb
> dbType="mysql" database="api06_test" user="osm" password="OpenStreetMap"
> validateSchemaVersion=no
>
> After 5+ minutes of running I get this error message:
> 2009.10.15. 19:04:30 org.openstreetmap.osmosis.core.Osmosis run
> INFO: Osmosis Version 0.31.2
> 2009.10.15. 19:04:32 org.openstreetmap.osmosis.core.Osmosis run
> INFO: Preparing pipeline.
> 2009.10.15. 19:04:32 org.openstreetmap.osmosis.core.Osmosis run
> INFO: Launching pipeline execution.
> 2009.10.15. 19:04:32 org.openstreetmap.osmosis.core.Osmosis run
> INFO: Pipeline executing, waiting for completion.
> date
> 2009.10.15. 19:09:23
> org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager
> waitForCompletion
> SEVERE: Thread for task 1-read-xml failed
> org.openstreetmap.osmosis.core.OsmosisRuntimeException: Unable to bulk
> insert nodes into the database.
> at
> org.openstreetmap.osmosis.core.apidb.v0_6.ApidbWriter.flushNodes(ApidbWriter.java:569)
> at
> org.openstreetmap.osmosis.core.apidb.v0_6.ApidbWriter.process(ApidbWriter.java:1078)
> at
> org.openstreetmap.osmosis.core.container.v0_6.NodeContainer.process(NodeContainer.java:58)
> at
> org.openstreetmap.osmosis.core.apidb.v0_6.ApidbWriter.process(ApidbWriter.java:1052)
> at
> org.openstreetmap.osmosis.core.xml.v0_6.impl.NodeElementProcessor.end(NodeElementProcessor.java:109)
> at
> org.openstreetmap.osmosis.core.xml.v0_6.impl.OsmHandler.endElement(OsmHandler.java:108)
> at
> org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown Source)
> at
> org.apache.xerces.parsers.AbstractXMLDocumentParser.emptyElement(Unknown
> Source)
> at
> org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanStartElement(Unknown
>
> Source)
> at
> org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown
>
> Source)
> at
> org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown
> Source)
> at org.apache.xerces.parsers.XML11Configuration.parse(Unknown
> Source)
> at org.apache.xerces.parsers.XML11Configuration.parse(Unknown
> Source)
> at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
> at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source)
> at
> org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source)
> at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source)
> at javax.xml.parsers.SAXParser.parse(SAXParser.java:198)
> at
> org.openstreetmap.osmosis.core.xml.v0_6.XmlReader.run(XmlReader.java:108)
> at java.lang.Thread.run(Thread.java:619)
> Caused by: java.sql.SQLException: The table 'nodes' is full
> at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1055)
> at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:956)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3491)
> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3423)
> at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1936)
> at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2060)
> at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2542)
> at
> com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1734)
> at
> com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2019)
> at
> com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:1937)
> at
> com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:1922)
> at
> org.openstreetmap.osmosis.core.apidb.v0_6.ApidbWriter.flushNodes(ApidbWriter.java:567)
> ... 19 more
> 2009.10.15. 19:09:23 org.openstreetmap.osmosis.core.Osmosis main
> SEVERE: Execution aborted.
> org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more
> tasks failed.
> at
> org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146)
> at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:85)
> at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:30)
>
>
> I've altered the table to allow 1000000000 rows (ALTER TABLE nodes
> MAX_ROWS=1000000000), but this didn't helped either.
>
> Could someone help me please? It would be very much appreciated!
>
> Thanks in advance,
> air
>
>
>
> _______________________________________________
> dev mailing list
> dev at openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
More information about the dev
mailing list