[OSM-dev] Osmosis shutting down while processing osm-file

[Brett Henderson]

Hi Ibrahim,

This sounds like the same problem encountered by Torge Szczepanek on 
21st July at 23:37 (UTC).  I've included the message I wrote to him at 
the time.

Let us know if this is a suitable workaround to the problem.

Brett


Hi Torge,

I haven't seen this particular error before.  My suspicion is that it's 
caused by ways referring to non-existent nodes.  I thought the code was 
capable of dealing with that scenario, but it looks like that isn't the 
case.

I don't have time to look into this at the moment, but one workaround 
might be to run the entire planet through the --bbox task:
--bbox clipIncompleteEntities=true idTrackerType=BitSet

The --bbox task as specified above will modify ways to ensure 
referential integrity.

I hope that helps.

Brett


IbrahimB22 wrote:
> Hi,
>
> I'm trying to load an osm file of belgium that I got off cloudmade.com into
> a postgresql database with postgis.
> I used the 0.6 script and added the linestring column to the ways-table in
> the postgresql database.
> The command I'm running is: 
>
> osmosis --read-xml file="belgium.osm" --write-pgsql host="127.0.0.1:5432"
> database="Routing" user="postgres" password="*********"
> enableLinestringBuilder="yes" nodeLocationStoreType="TempFile"
>
> the output is:
>
> INFO: Osmosis Version 0.31.1
> 23-jul-2009 18:56:01 org.openstreetmap.osmosis.core.Osmosis run
> INFO: Preparing pipeline.
> 23-jul-2009 18:56:01 org.openstreetmap.osmosis.core.Osmosis run
> INFO: Launching pipeline execution.
> 23-jul-2009 18:56:01 org.openstreetmap.osmosis.core.Osmosis run
> INFO: Pipeline executing, waiting for completion.
> 23-jul-2009 19:02:51
> org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager
> waitForCompletion
> SEVERE: Thread for task 1-read-xml failed
> java.lang.NullPointerException
>         at org.postgis.PGgeometry.getValue(Unknown Source)
>         at
> org.postgresql.jdbc2.AbstractJdbc2Statement.setPGobject(AbstractJdbc2Statement.java:1546)
>         at
> org.postgresql.jdbc2.AbstractJdbc2Statement.setObject(AbstractJdbc2Statement.java:1736)
>         at
> org.openstreetmap.osmosis.core.pgsql.v0_6.impl.WayMapper.populateEntityParameters(WayMapper.java:148)
>         at
> org.openstreetmap.osmosis.core.pgsql.v0_6.PostgreSqlWriter.flushWays(PostgreSqlWriter.java:491)
>         at
> org.openstreetmap.osmosis.core.pgsql.v0_6.PostgreSqlWriter.process(PostgreSqlWriter.java:943)
>         at
> org.openstreetmap.osmosis.core.container.v0_6.WayContainer.process(WayContainer.java:60)
>         at
> org.openstreetmap.osmosis.core.pgsql.v0_6.PostgreSqlWriter.process(PostgreSqlWriter.java:907)
>         at
> org.openstreetmap.osmosis.core.xml.v0_6.impl.WayElementProcessor.end(WayElementProcessor.java:108)
>         at
> org.openstreetmap.osmosis.core.xml.v0_6.impl.OsmHandler.endElement(OsmHandler.java:108)
>         at
> com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.endElement(Unknown
> Source)
>         at
> com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(Unknown
> Source)
>         at
> com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(Unknown
> Source)
>         at
> com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(Unknown
> Source)
>         at
> com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown
> Source)
>         at
> com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown
> Source)
>         at
> com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown
> Source)
>         at
> com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(Unknown Source)
>         at
> com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(Unknown
> Source)
>         at
> com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown
> Source)
>         at javax.xml.parsers.SAXParser.parse(Unknown Source)
>         at javax.xml.parsers.SAXParser.parse(Unknown Source)
>         at
> org.openstreetmap.osmosis.core.xml.v0_6.XmlReader.run(XmlReader.java:108)
>         at java.lang.Thread.run(Unknown Source)
> 23-jul-2009 19:02:51 org.openstreetmap.osmosis.core.Osmosis main
> SEVERE: Execution aborted.
> org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks
> failed.
>         at
> org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146)
>         at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:85)
>         at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:30)
>
> I have no clue what the problem is, at first I thought it might be because
> I'm working on a small windows partition that was almost full, and that
> osmosis couldn't write to the temporary file directory anymore. But then I
> did a cleanup of my HD and freed up about 13GB, and the problem still
> remains.
>
> Kind Regards,
>
> Ibrahim
>