[OSM-dev] Osmosis RuntimeException: Pipeline entities are not sorted

Michael Kussmaul kussmaul.list at nix.ch
Thu May 12 11:40:43 UTC 2016


Hi Brett

I tried with --sort-change, but had the same result.

It looks like I need to re-import the full planet again and then go on with daily updates - I just hope the error does not get propagated further along in the daily-diffs.

many thanks for your investigation!
Michael

> On 12.05.2016, at 12:33, Brett Henderson <brett at bretth.com> wrote:
> 
> 
> Actually, on closer inspection of the error it looks like the same node (257882) is appearing twice with the same version.  I doubt if sorting will help.  I don't think Osmosis has a way to fix this issue.  The simplify change task could probably cope with it, but the input validation may be too strict.  It may be necessary to fix the file manually ...
> 
> On Thu, 12 May 2016 at 20:30 Brett Henderson <brett at bretth.com <mailto:brett at bretth.com>> wrote:
> Okay, so the --simplify-change task is failing because it requires sorted input.
> 
> Can you try this?  It will sort the changes before attempting to simplify them.
> osmosis —read-replication-interval workingDirectory=/import/data/diffs/ --sort-change --simplify-change --write-xml-change /import/data/diffs/data/changes.osc.gz
> 
> 
> On Thu, 12 May 2016 at 19:43 Michael Kussmaul <kussmaul.list at nix.ch <mailto:kussmaul.list at nix.ch>> wrote:
> Hi Brett
> 
> Sure, here is my stack trace:
> 
> May 11, 2016 1:34:36 PM org.openstreetmap.osmosis.core.Osmosis run
> INFO: Osmosis Version 0.44.1
> May 11, 2016 1:34:36 PM org.openstreetmap.osmosis.core.Osmosis run
> INFO: Preparing pipeline.
> May 11, 2016 1:34:36 PM org.openstreetmap.osmosis.core.Osmosis run
> INFO: Launching pipeline execution.
> May 11, 2016 1:34:36 PM org.openstreetmap.osmosis.core.Osmosis run
> INFO: Pipeline executing, waiting for completion.
> May 11, 2016 1:48:18 PM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager waitForCompletion
> SEVERE: Thread for task 1-read-replication-interval failed
> org.openstreetmap.osmosis.core.OsmosisRuntimeException: Pipeline entities are not sorted, previous entity type=Node, id=257882, version=5 current entity type=Node, id=257882, version=5.
> 	at org.openstreetmap.osmosis.core.sort.v0_6.SortedHistoryChangePipeValidator.process(SortedHistoryChangePipeValidator.java:59)
> 	at org.openstreetmap.osmosis.set.v0_6.ChangeSimplifier.process(ChangeSimplifier.java:50)
> 	at org.openstreetmap.osmosis.core.sort.v0_6.ChangeSorter.complete(ChangeSorter.java:73)
> 	at org.openstreetmap.osmosis.replication.v0_6.ReplicationDownloader.processComplete(ReplicationDownloader.java:116)
> 	at org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.runImpl(BaseReplicationDownloader.java:313)
> 	at org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.run(BaseReplicationDownloader.java:383)
> 	at java.lang.Thread.run(Thread.java:744)
> 
> May 11, 2016 1:48:18 PM org.openstreetmap.osmosis.core.Osmosis main
> SEVERE: Execution aborted.
> org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks failed.
> 	at org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146)
> 	at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:92)
> 	at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:37)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:330)
> 	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:238)
> 	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> 	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> 	at org.codehaus.classworlds.Launcher.main(Launcher.java:47)
> 
> 
> 
>> On 12.05.2016, at 05:15, Brett Henderson <brett at bretth.com <mailto:brett at bretth.com>> wrote:
>> 
>> Can you provide more of the stack trace?  It would be helpful to see exactly which task in the pipeline is failing.  It *may* be possible to workaround it it with an intermediate sort task.
>> 
>> On Wed, 11 May 2016 at 21:43 Michael Kussmaul <kussmaul.list at nix.ch <mailto:kussmaul.list at nix.ch>> wrote:
>> Yes, I see the same problem, I’m using osmosis to keep my local planet file up-to-date and now see the same error as Jan Michel:
>> 
>> org.openstreetmap.osmosis.core.OsmosisRuntimeException: Pipeline entities are not sorted, previous entity type=Node, id=257882, version=5 current entity type=Node, id=257882, version=5.
>> 
>> Again node 257882.
>> 
>> My osmosis command:
>> osmosis —read-replication-interval workingDirectory=/import/data/diffs/ --simplify-change --write-xml-change /import/data/diffs/data/changes.osc.gz
>> 
>> kind regards
>> Michael
>> _______________________________________________
>> dev mailing list
>> dev at openstreetmap.org <mailto:dev at openstreetmap.org>
>> https://lists.openstreetmap.org/listinfo/dev <https://lists.openstreetmap.org/listinfo/dev>
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20160512/75bd1c31/attachment-0001.html>


More information about the dev mailing list