[OSM-dev] Osmosis Error on postgis import of planet file in org.PGgeometry.getValue

[Brett Henderson]

Hi Torge,

I haven't seen this particular error before.  My suspicion is that it's 
caused by ways referring to non-existent nodes.  I thought the code was 
capable of dealing with that scenario, but it looks like that isn't the 
case.

I don't have time to look into this at the moment, but one workaround 
might be to run the entire planet through the --bbox task:
--bbox clipIncompleteEntities=true idTrackerType=BitSet

The --bbox task as specified above will modify ways to ensure 
referential integrity.

I hope that helps.

Brett

PS. The --write-pgsql task is slow for very large datasets.  You would 
be better off using the --write-pgsql-dump task and loading the COPY 
files into the database as a separate step, it is much much faster.

Torge Szczepanek wrote:
> Hi List!
>
> I am doing some osmosis imports for some time now with extracts from
> http://download.geofabrik.de/ into postgis/postgres. These imports are
> working fine for the extracts (same import command as below).
>
> Now I am trying to import the planet file into a postgres/postgis
> database with enabled bbox and geometries using the following command:
>
> bzcat 20090715/planet-090715.osm.bz2 osmosis-0.31/bin/osmosis --read-xml
> - --write-pgsql host=localhost database=osm-planet-090715-20090715
> user=*** password=*** enableBboxBuilder=yes enableLinestringBuilder=yes
> nodeLocationStoreType=TempFile
>
> Has anyone encountered this kind of problem before?
>
> Greetings Torge
>
> Full trace:
>
>
> SCHWERWIEGEND: Thread for task 1-read-xml failed
> java.lang.NullPointerException
>         at org.postgis.PGgeometry.getValue(Unknown Source)
>         at
> org.postgresql.jdbc2.AbstractJdbc2Statement.setPGobject(AbstractJdbc2Statement.java:1546)
>         at
> org.postgresql.jdbc2.AbstractJdbc2Statement.setObject(AbstractJdbc2Statement.java:1736)
>         at
> org.openstreetmap.osmosis.core.pgsql.v0_6.impl.WayMapper.populateEntityParameters(WayMapper.java:148)
>         at
> org.openstreetmap.osmosis.core.pgsql.v0_6.PostgreSqlWriter.flushWays(PostgreSqlWriter.java:491)
>         at
> org.openstreetmap.osmosis.core.pgsql.v0_6.PostgreSqlWriter.process(PostgreSqlWriter.java:943)
>         at
> org.openstreetmap.osmosis.core.container.v0_6.WayContainer.process(WayContainer.java:60)
>         at
> org.openstreetmap.osmosis.core.pgsql.v0_6.PostgreSqlWriter.process(PostgreSqlWriter.java:907)
>         at
> org.openstreetmap.osmosis.core.xml.v0_6.impl.WayElementProcessor.end(WayElementProcessor.java:108)
>         at
> org.openstreetmap.osmosis.core.xml.v0_6.impl.OsmHandler.endElement(OsmHandler.java:108)
>         at
> com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(AbstractSAXParser.java:601)
>         at
> com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(XMLDocumentFragmentScannerImpl.java:1774)
>         at
> com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2930)
>         at
> com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:648)
>         at
> com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:510)
>         at
> com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807)
>         at
> com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
>         at
> com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107)
>         at
> com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205)
>         at
> com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:522)
>         at javax.xml.parsers.SAXParser.parse(SAXParser.java:395)
>         at javax.xml.parsers.SAXParser.parse(SAXParser.java:198)
>         at
> org.openstreetmap.osmosis.core.xml.v0_6.XmlReader.run(XmlReader.java:108)
>         at java.lang.Thread.run(Thread.java:637)
> 21.07.2009 22:02:50 org.openstreetmap.osmosis.core.Osmosis main
> SCHWERWIEGEND: Execution aborted.
> org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more
> tasks failed.
>         at
> org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146)
>         at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:85)
>         at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:30)
>
> _______________________________________________
> dev mailing list
> dev at openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>