[osmosis-dev] read buffer output error after moving from 0.39 to 0.40.1

[Brett Henderson]

Hi Simon,

On 8 February 2012 23:17, Simon Nuttall <simon.nuttall at gmail.com> wrote:

<snip>

>
> Produces:
>
>
> 08-Feb-2012 12:03:27 org.openstreetmap.osmosis.core.Osmosis run
> INFO: Osmosis Version 0.40.1
> 08-Feb-2012 12:03:27 org.openstreetmap.osmosis.core.TaskRegistrar
> loadBuiltInPlugins
> FINER: Loading plugin configuration file from url
>
> jar:file:/usr/local/osmosis/current/lib/default/osmosis-areafilter-0.40.1.jar!/osmosis-plugins.conf.
> .
> .
> .08-Feb-2012 12:03:37
> org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager
> waitForCompletion
> FINE: Waiting for task 1-read-pbf to complete.
> 08-Feb-2012 12:03:46
> org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager
> waitForCompletion
> SEVERE: Thread for task 1-read-pbf failed
> org.openstreetmap.osmosis.core.OsmosisRuntimeException: An output
> error has occurred, aborting.
>        at
> org.openstreetmap.osmosis.core.store.DataPostbox.checkForOutputErrors(DataPostbox.java:78)
>        at
> org.openstreetmap.osmosis.core.store.DataPostbox.populateCentralQueue(DataPostbox.java:134)
>        at
> org.openstreetmap.osmosis.core.store.DataPostbox.put(DataPostbox.java:184)
>        at
> org.openstreetmap.osmosis.set.v0_6.impl.DataPostboxSink.process(DataPostboxSink.java:34)
>        at
> org.openstreetmap.osmosis.core.sort.v0_6.SortedEntityPipeValidator.process(SortedEntityPipeValidator.java:58)
>        at
> org.openstreetmap.osmosis.tagfilter.v0_6.TagFilter.process(TagFilter.java:133)
>        at
> org.openstreetmap.osmosis.tagfilter.v0_6.TagFilter.process(TagFilter.java:133)
>        at
> crosby.binary.osmosis.OsmosisBinaryParser.parseDense(OsmosisBinaryParser.java:139)
>        at crosby.binary.BinaryParser.parse(BinaryParser.java:124)
>        at crosby.binary.BinaryParser.handleBlock(BinaryParser.java:68)
>        at crosby.binary.file.FileBlock.process(FileBlock.java:135)
>        at
> crosby.binary.file.BlockInputStream.process(BlockInputStream.java:34)
>        at crosby.binary.osmosis.OsmosisReader.run(OsmosisReader.java:37)
>        at java.lang.Thread.run(Thread.java:636)
> 08-Feb-2012 12:03:46
> org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager
> waitForCompletion
> FINE: Task 2-tag-filter is passive, no completion wait required.
>

Do other exceptions occur earlier in the console output?  The above
exception is from a different thread to where the original exception
occurred.  One thread has encountered an exception and failed, then another
thread trying to write into a buffer that they share fails with the above
exception.

Can you provide a more complete console output, or at least look for the
cause exception message?  Also, is it possible to reduce the size of your
command line by breaking it into sub-commands.  If I'm interpreting your
command line properly it should be possible to read your PBF files and
perform filtering in separate Osmosis invocations writing to intermediate
files, then merge into a single file, then write to the database.

Brett
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/osmosis-dev/attachments/20120215/e36226da/attachment.html>