[osmosis-dev] osmosis pipelining troubles
MERIGHI Marcus
mcmer-osmosisdev at tor.at
Wed Dec 7 09:00:55 GMT 2011
Hello,
while trying to integrate various processing steps into a rather complex
pipeline I have run into troubles. Each step alone seems to work, even
more complex arrangements, but not all of them. (Go to bottom of message
(3) to see an working example with multiple invocations of osmosis.)
The osmosis commands below (1) stop at "FINE: Waiting for task
1-read-xml to complete.", probably forever. CPU utilization goes up
first and then slowly down to zero, fstat does not show any read
activity on the input file (anymore).
I have tried to pin down at what point the processing hangs; everything
before "--derive-change" works, tested with "--write-null[-change]".
The questions are:
1) Am I getting something fundamentally wrong about the way osmosis
pipes work?
2) Is there any obvious mistake in my parameters?
3) Have I hit a bug?
(BTW, basicly I am after simplifying ways; but --simplify-ways leaves
(now) unused nodes behind; getting rid of them by means of --used-node
removes poi-type nodes as well (not used in ways and relations).
Therefore I have to go the long way of diffing before- and after
--used-node, parse that for "used" (i.e., poi-type) nodes and merge.)
Thanks in advance for any pointers!
Marcus
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
(1) the command:
osmosis \
-verbose 5 \
--read-xml file="${_src}" outPipe.0=source \
--sort inPipe.0=source outPipe.0=sourcesort \
--simplify-ways epsilonMeters="${_err}" inPipe.0=sourcesort outPipe.0=norm \
--sort inPipe.0=norm outPipe.0=normsort \
--tee inPipe.0=normsort outPipe.0=fullnorm outPipe.1=tousedonly \
--used-node inPipe.0=tousedonly outPipe.0=usedonly \
--sort inPipe.0=usedonly outPipe.0=usedonlysort \
--tee inPipe.0=usedonlysort outPipe.0=usedonlymerge outPipe.1=usedonlydiff \
--derive-change inPipe.0=fullnorm inPipe.1=usedonlydiff outPipe.0=diff \
--sort-change inPipe.0=diff outPipe.0=diffsort \
--read-empty outPipe.0=empty \
--apply-change inPipe.0=empty inPipe.1=diffsort outPipe.0=diffosm \
--tag-transform file="${HOME}/.nonemptynodes.xml" inPipe.0=diffosm outPipe.0=tt \
--node-key keyList="is_poi" inPipe.0=tt outPipe.0=pois \
--merge inPipe.0=usedonlymerge inPipe.1=pois outPipe.0=merged \
--write-xml inPipe.0=merged file="${_tgt}"
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
(2) the output
Dez 06, 2011 2:48:46 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Osmosis Version 0.40
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin configuration file from url jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-apidb-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin via loader org.openstreetmap.osmosis.apidb.ApidbPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin configuration file from url jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-areafilter-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin via loader org.openstreetmap.osmosis.areafilter.AreaFilterPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin configuration file from url jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-core-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin via loader org.openstreetmap.osmosis.core.CorePluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin configuration file from url jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-dataset-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin via loader org.openstreetmap.osmosis.dataset.DatasetPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin configuration file from url jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-pbf-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin via loader crosby.binary.osmosis.BinaryPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin configuration file from url jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-pgsimple-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin via loader org.openstreetmap.osmosis.pgsimple.PgSimplePluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin configuration file from url jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-pgsnapshot-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin via loader org.openstreetmap.osmosis.pgsnapshot.PgSnapshotPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin configuration file from url jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-replication-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin via loader org.openstreetmap.osmosis.replication.ReplicationPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin configuration file from url jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-set-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin via loader org.openstreetmap.osmosis.set.SetPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin configuration file from url jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-tagfilter-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin via loader org.openstreetmap.osmosis.tagfilter.TagFilterPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin configuration file from url jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-xml-0.40.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin via loader org.openstreetmap.osmosis.xml.XmlPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin configuration file from url jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-simplifyways-v0.39.1.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin via loader de.vwistuttgart.openstreetmap.osmosis.simplifyways.SimplifyWaysPluginLoader.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin configuration file from url jar:file:/home/asfer/bin/osmosis-0.40/lib/default/tagtransform.jar!/osmosis-plugins.conf.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadBuiltInPlugins
FINER: Loading plugin via loader uk.co.randomjunk.osmosis.transform.TransformPlugin.
Dez 06, 2011 2:48:47 PM org.java.plugin.ObjectFactory loadProperties
FINE: no jpf.properties file found in ${java.home}/lib (/usr/local/jdk-1.7.0/jre/lib/jpf.properties) nor in CLASSPATH, using standard properties
Dez 06, 2011 2:48:47 PM org.java.plugin.ObjectFactory loadProperties
FINE: loaded jpf.properties from jar:file:/home/asfer/bin/osmosis-0.40/lib/default/jpf-1.5.jar!/org/java/plugin/standard/jpf.properties
Dez 06, 2011 2:48:47 PM org.java.plugin.ObjectFactory findProperty
FINE: property org.java.plugin.ObjectFactory found in properties file
Dez 06, 2011 2:48:47 PM org.java.plugin.ObjectFactory newInstance
FINE: object factory instance created - org.java.plugin.standard.StandardObjectFactory at 1a1ed04
Dez 06, 2011 2:48:47 PM org.java.plugin.standard.StandardObjectFactory getImplClassName
FINE: implementation class for org.java.plugin.registry.PluginRegistry is org.java.plugin.registry.xml.PluginRegistryImpl
Dez 06, 2011 2:48:47 PM org.java.plugin.registry.xml.ManifestParser <init>
INFO: got SAX parser factory - org.apache.xerces.jaxp.SAXParserFactoryImpl at 177ee02
Dez 06, 2011 2:48:47 PM org.java.plugin.registry.xml.PluginRegistryImpl configure
INFO: configured, stopOnError=false, isValidating=true
Dez 06, 2011 2:48:47 PM org.java.plugin.standard.StandardObjectFactory createRegistry
FINE: registry instance created - org.java.plugin.registry.xml.PluginRegistryImpl at aaf438
Dez 06, 2011 2:48:47 PM org.java.plugin.standard.StandardObjectFactory getImplClassName
FINE: implementation class for org.java.plugin.PathResolver is org.java.plugin.standard.StandardPathResolver
Dez 06, 2011 2:48:47 PM org.java.plugin.standard.StandardObjectFactory createPathResolver
FINE: path resolver instance created - org.java.plugin.standard.StandardPathResolver at 203a16
Dez 06, 2011 2:48:47 PM org.java.plugin.standard.StandardObjectFactory getImplClassName
FINE: implementation class for org.java.plugin.standard.PluginLifecycleHandler is org.java.plugin.standard.StandardPluginLifecycleHandler
Dez 06, 2011 2:48:47 PM org.java.plugin.standard.StandardPluginLifecycleHandler configure
FINE: probeParentLoaderLast parameter value is false
Dez 06, 2011 2:48:47 PM org.java.plugin.standard.StandardObjectFactory createLifecycleHandler
FINE: life cycle handler instance created - org.java.plugin.standard.StandardPluginLifecycleHandler at 1b47cc2
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadJPFPlugins
FINE: Searching for JPF plugins.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar gatherJpfPlugins
FINER: Loading plugins in /home/asfer/Daten/GIS/test/plugins
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar gatherJpfPlugins
FINER: Loading plugins in /home/asfer/.openstreetmap/osmosis/plugins
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar gatherJpfPlugins
FINER: Loading plugins in /home/asfer/Daten/GIS/test/null/openstreetmap/osmosis/plugins
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar loadJPFPlugins
FINE: Registering the core plugin.
Dez 06, 2011 2:48:47 PM org.openstreetmap.osmosis.core.TaskRegistrar registerCorePlugin
FINEST: Plugin URL: jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-core-0.40.jar!/org/openstreetmap/osmosis/core/plugin/plugin.xml
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestParser$1 resolveEntity
FINE: entity resolved to plug-in manifest DTD, publicId=-//JPF//Java Plug-in Manifest 1.0, systemId=http://jpf.sourceforge.net/plugin_1_0.dtd
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestHandler startElement
FINE: startElement - []/[]/[plugin]
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestHandler startElement
FINE: startElement - []/[]/[extension-point]
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestHandler startElement
FINE: startElement - []/[]/[parameter-def]
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestHandler endElement
FINE: endElement - []/[]/[parameter-def]
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestHandler startElement
FINE: startElement - []/[]/[parameter-def]
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestHandler endElement
FINE: endElement - []/[]/[parameter-def]
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestHandler endElement
FINE: endElement - []/[]/[extension-point]
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ManifestHandler endElement
FINE: endElement - []/[]/[plugin]
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.PluginRegistryImpl register
FINE: manifest files parsed, plugins.size=1, fragments.size=0
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.PluginRegistryImpl register
FINE: plug-ins versions checked, plugins.size=1
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.PluginRegistryImpl register
FINE: plug-in fragments versions checked, fragments.size=0
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.PluginRegistryImpl registerPlugin
FINE: registering plug-in, URL - jar:file:/home/asfer/bin/osmosis-0.40/lib/default/osmosis-core-0.40.jar!/org/openstreetmap/osmosis/core/plugin/plugin.xml
Dez 06, 2011 2:48:48 PM org.java.plugin.registry.xml.ExtensionPointImpl$ParameterDefinitionImpl <init>
FINE: object instantiated: {PluginExtensionPoint.ParameterDefinition: extPointUid=org.openstreetmap.osmosis.core.plugin.Core at Task; id=class}
Dez 06, 2011 2:48:49 PM org.java.plugin.registry.xml.ExtensionPointImpl$ParameterDefinitionImpl <init>
FINE: object instantiated: {PluginExtensionPoint.ParameterDefinition: extPointUid=org.openstreetmap.osmosis.core.plugin.Core at Task; id=name}
Dez 06, 2011 2:48:49 PM org.java.plugin.registry.xml.ExtensionPointImpl <init>
FINE: object instantiated: {ExtensionPoint: uid=org.openstreetmap.osmosis.core.plugin.Core at Task}
Dez 06, 2011 2:48:49 PM org.java.plugin.registry.xml.PluginDescriptorImpl <init>
FINE: object instantiated: {PluginDescriptor: uid=org.openstreetmap.osmosis.core.plugin.Core at 0.40.0}
Dez 06, 2011 2:48:49 PM org.java.plugin.registry.xml.PluginRegistryImpl register
INFO: plug-in and fragment descriptors registered - 1
Dez 06, 2011 2:48:49 PM org.java.plugin.registry.xml.PluginRegistryImpl dump
FINE: PLUG-IN REGISTRY DUMP:
-------------- DUMP BEGIN -----------------
Plug-ins: 1
{PluginDescriptor: uid=org.openstreetmap.osmosis.core.plugin.Core at 0.40.0}
Fragments: 0
Memory TOTAL/FREE/MAX: 16252928/12468600/259522560
-------------- DUMP END -----------------
Dez 06, 2011 2:48:49 PM org.java.plugin.registry.xml.PluginRegistryImpl$RegistryChangeDataImpl dump
FINE: PLUG-IN REGISTRY CHANGES DUMP:
-------------- DUMP BEGIN -----------------
Added plug-ins: 1
org.openstreetmap.osmosis.core.plugin.Core
Removed plug-ins: 0
Modified plug-ins: 0
Added extensions: 0
Removed extensions: 0
Modified extensions: 0
Memory TOTAL/FREE/MAX: 16252928/12468600/259522560
-------------- DUMP END -----------------
Dez 06, 2011 2:48:49 PM org.java.plugin.registry.xml.PluginRegistryImpl fireEvent
FINE: propagating registry change event
Dez 06, 2011 2:48:49 PM org.java.plugin.registry.xml.PluginRegistryImpl fireEvent
FINE: registry change event propagated
Dez 06, 2011 2:48:49 PM org.java.plugin.standard.StandardPluginClassLoader getUrls
FINE: Code URL's populated for plug-in {PluginDescriptor: uid=org.openstreetmap.osmosis.core.plugin.Core at 0.40.0}:
Dez 06, 2011 2:48:49 PM org.java.plugin.standard.StandardPluginClassLoader$PluginResourceLoader get
FINEST: Resource URL's populated for plug-in {PluginDescriptor: uid=org.openstreetmap.osmosis.core.plugin.Core at 0.40.0}:
Dez 06, 2011 2:48:49 PM org.java.plugin.standard.StandardPluginManager activatePlugin
INFO: plug-in started - org.openstreetmap.osmosis.core.plugin.Core at 0.40.0
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.TaskRegistrar loadJPFPlugins
FINE: Registering the extension plugins.
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Preparing pipeline.
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline prepare
FINE: Building tasks.
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "1-read-xml"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "2-sort"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "3-simplify-ways"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "4-sort"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "5-tee"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "6-used-node"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "7-sort"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "8-tee"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "9-derive-change"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "10-sort-change"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "11-read-empty"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "12-apply-change"
Dez 06, 2011 2:48:49 PM uk.co.randomjunk.osmosis.transform.impl.TransformHelper <init>
FINE: Transform configured with /home/asfer/.nonemptynodes.xml and null
Dez 06, 2011 2:48:49 PM uk.co.randomjunk.osmosis.transform.impl.TransformLoader parseTranslation
INFO: New translation: remove empty nodes
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "13-tag-transform"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "14-node-key"
Dez 06, 2011 2:48:49 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "15-merge"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline buildTasks
FINE: Created task "16-write-xml"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline prepare
FINE: Connecting tasks.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "1-read-xml" produced pipe "source"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "1-read-xml"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "2-sort" consumed pipe "source"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "2-sort" produced pipe "sourcesort"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "2-sort"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "3-simplify-ways" consumed pipe "sourcesort"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "3-simplify-ways" produced pipe "norm"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "3-simplify-ways"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "4-sort" consumed pipe "norm"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "4-sort" produced pipe "normsort"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "4-sort"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "5-tee" consumed pipe "normsort"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "5-tee" produced pipe "fullnorm"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "5-tee" produced pipe "tousedonly"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "5-tee"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "6-used-node" consumed pipe "tousedonly"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "6-used-node" produced pipe "usedonly"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "6-used-node"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "7-sort" consumed pipe "usedonly"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "7-sort" produced pipe "usedonlysort"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "7-sort"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "8-tee" consumed pipe "usedonlysort"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "8-tee" produced pipe "usedonlymerge"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "8-tee" produced pipe "usedonlydiff"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "8-tee"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "9-derive-change" consumed pipe "fullnorm"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "9-derive-change" consumed pipe "usedonlydiff"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "9-derive-change" produced pipe "diff"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "9-derive-change"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "10-sort-change" consumed pipe "diff"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "10-sort-change" produced pipe "diffsort"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "10-sort-change"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "11-read-empty" produced pipe "empty"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "11-read-empty"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "12-apply-change" consumed pipe "empty"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "12-apply-change" consumed pipe "diffsort"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "12-apply-change" produced pipe "diffosm"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "12-apply-change"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "13-tag-transform" consumed pipe "diffosm"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "13-tag-transform" produced pipe "tt"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "13-tag-transform"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "14-node-key" consumed pipe "tt"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "14-node-key" produced pipe "pois"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "14-node-key"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "15-merge" consumed pipe "usedonlymerge"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "15-merge" consumed pipe "pois"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks putTask
FINE: Task "15-merge" produced pipe "merged"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "15-merge"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PipeTasks retrieveTask
FINE: Task "16-write-xml" consumed pipe "merged"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.Pipeline connectTasks
FINE: Connected task "16-write-xml"
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Launching pipeline execution.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager execute
FINE: Launching task 1-read-xml in a new thread.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 2-sort is passive, no execution required.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 3-simplify-ways is passive, no execution required.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 4-sort is passive, no execution required.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 5-tee is passive, no execution required.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 6-used-node is passive, no execution required.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 7-sort is passive, no execution required.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 8-tee is passive, no execution required.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager execute
FINE: Launching task 9-derive-change in a new thread.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 10-sort-change is passive, no execution required.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager execute
FINE: Launching task 11-read-empty in a new thread.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager execute
FINE: Launching task 12-apply-change in a new thread.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 13-tag-transform is passive, no execution required.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 14-node-key is passive, no execution required.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager execute
FINE: Launching task 15-merge in a new thread.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.PassiveTaskManager execute
FINE: Task 16-write-xml is passive, no execution required.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline executing, waiting for completion.
Dez 06, 2011 2:48:50 PM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager waitForCompletion
FINE: Waiting for task 1-read-xml to complete.
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
(3) a working example
_td=$(mktemp -t -d osmnorm-XXXXXX)
_fnnorm="${_td}/norm.osm"
_fnused="${_td}/used.osm"
_fnpois="${_td}/pois.osm"
_fndiff="${_td}/diff.osm"
print simplify-ways
osmosis \
-verbose 0 \
--read-xml file="${_src}" outPipe.0=source \
--sort inPipe.0=source outPipe.0=sourcesort \
--simplify-ways epsilonMeters="${_err}" inPipe.0=sourcesort outPipe.0=norm \
--sort inPipe.0=norm outPipe.0=normsort \
--write-xml inPipe.0=normsort file="${_fnnorm}"
print used-node
osmosis \
-verbose 0 \
--read-xml file="${_fnnorm}" outPipe.0=norm \
--used-node inPipe.0=norm outPipe.0=usedonly \
--sort inPipe.0=usedonly outPipe.0=usedonlysort \
--write-xml inPipe.0=usedonlysort file="${_fnused}"
print derive-change
osmosis \
-verbose 0 \
--read-xml file="${_fnnorm}" outPipe.0=norm \
--read-xml file="${_fnused}" outPipe.0=used \
--derive-change inPipe.0=used inPipe.1=norm outPipe.0=diff \
--sort-change inPipe.0=diff outPipe.0=diffsort \
--read-empty outPipe.0=empty \
--apply-change inPipe.0=empty inPipe.1=diffsort outPipe.0=diffosm \
--write-xml inPipe.0=diffosm file="${_fndiff}"
print tag-transform, node-key
osmosis \
-verbose 0 \
--read-xml file="${_fndiff}" outPipe.0=diffosm \
--tag-transform file="${HOME}/.nonemptynodes.xml" inPipe.0=diffosm outPipe.0=tt \
--node-key keyList="is_poi" inPipe.0=tt outPipe.0=pois \
--write-xml inPipe.0=pois file="${_fnpois}"
print merge
osmosis \
-verbose 0 \
--read-xml file="${_fnused}" outPipe.0=used \
--read-xml file="${_fnpois}" outPipe.0=pois \
--merge inPipe.0=used inPipe.1=pois outPipe.0=merged \
--write-xml inPipe.0=merged file="${_tgt}"
rm -rf "${_td}"
More information about the osmosis-dev
mailing list