[Geocoding] Accidentally stopped Nominatim install - can it be resumed?

[Simon Nuttall]

On 19 July 2013 18:41, Sarah Hoffmann <lonvia at denofr.de> wrote:
> Hi Simon,
>
> On Fri, Jul 19, 2013 at 06:11:38PM +0100, Simon Nuttall wrote:
>> Sarah,
>>
>> Thanks for the tip about threads, having increased that to two threads
>> the machine carried on at full power and completed earlier this
>> morning.
>>
>> Our install script now appears to be running this:
>>
>> ./utils/setup.php --osmosis-init
>>
>> which is producing cycles of output like that below every few minutes.
>> Is this normal, should I be worried?
>
> Are you sure about --osmosis-init?

No, I wasn't sure. I think I may have missed some log output because
of permissions on my log file, which I've now changed in our install
script.
https://github.com/cyclestreets/nominatim-install/commit/dfdbe58b1ddb82b39741a64ffb99a7f96d2989d5

> It looks like you are trying to apply
> updates (./utils/update.php --import-osmosis-all).

OK, yes I think so.

>
> I have seen this error before with the daily updates for excerpts from Geofabrik.
> They cannot be merged and must be applied one after another. Check your
> update setup in settings/configuration.txt again. maxInterval should
> be set to at maximum one day.

That file currently contains...

# The URL of the directory containing change files.
baseUrl=http://download.geofabrik.de/europe-updates

# Defines the maximum time interval in seconds to download in a single
invocation.
# Setting to 0 disables this feature.
maxInterval = 259200

I've changed that to 86400 now.

> After you have fixed that, you might want
> to check settings/state.txt that it is still at the date where you expect
> updates to start.

# original OSM minutely replication sequence number 427417
timestamp=2013-07-08T18\:59\:06Z
sequenceNumber=123


Which  seems sensible.

I've restarted the:

sudo -u nominatim ./utils/update.php --import-osmosis-all --no-npi

Thanks,

Simon

>
> Checking the wiki, it looks like the installation instructions contain
> a bad recommendation on maxInterval. I'll fix that later.
>
> Sarah
>
>
>
>> Error: 1
>> Re-trying: /usr/bin/osmosis --read-replication-interval
>> workingDirectory=/home/nominatim/Nominatim/settings --simplify-change
>> --write-xml-change /home/nominatim/Nominatim/data/osmosischange.osc
>> 19-Jul-2013 18:05:10 org.openstreetmap.osmosis.core.Osmosis run
>> INFO: Osmosis Version 0.40.1
>> 19-Jul-2013 18:05:10 org.openstreetmap.osmosis.core.Osmosis run
>> INFO: Preparing pipeline.
>> 19-Jul-2013 18:05:10 org.openstreetmap.osmosis.core.Osmosis run
>> INFO: Launching pipeline execution.
>> 19-Jul-2013 18:05:10 org.openstreetmap.osmosis.core.Osmosis run
>> INFO: Pipeline executing, waiting for completion.
>> 19-Jul-2013 18:06:14
>> org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager
>> waitForCompletion
>> SEVERE: Thread for task 1-read-replication-interval failed
>> org.openstreetmap.osmosis.core.OsmosisRuntimeException: Pipeline
>> entities are not sorted, previous entity type=Node, id=26303082,
>> version=3 current entity type=Node, id=26303082, version=3.
>>         at org.openstreetmap.osmosis.core.sort.v0_6.SortedHistoryChangePipeValidator.process(SortedHistoryChangePipeValidator.java:50)
>>         at org.openstreetmap.osmosis.set.v0_6.ChangeSimplifier.process(ChangeSimplifier.java:39)
>>         at org.openstreetmap.osmosis.core.sort.v0_6.ChangeSorter.complete(ChangeSorter.java:64)
>>         at org.openstreetmap.osmosis.replication.v0_6.ReplicationDownloader.processComplete(ReplicationDownloader.java:93)
>>         at org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.runImpl(BaseReplicationDownloader.java:288)
>>         at org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader.run(BaseReplicationDownloader.java:349)
>>         at java.lang.Thread.run(Thread.java:679)
>> 19-Jul-2013 18:06:14 org.openstreetmap.osmosis.core.Osmosis main
>> SEVERE: Execution aborted.
>> org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more
>> tasks failed.
>>         at org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146)
>>         at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:92)
>>         at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:37)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:616)
>>         at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:328)
>>         at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:238)
>>         at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:408)
>>         at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:351)
>>         at org.codehaus.classworlds.Launcher.main(Launcher.java:31)
>> Error: 1



--
Simon Nuttall

Route Master, CycleStreets.net