[Geocoding] update nominatim data

[Sarah Hoffmann]

Hi Mirko,

after looking a bit closer into this, it looks like the osmosis
version supplied with most distributions is simply too old. 
You need to install the newest version manually.

There is now a new section in the installation instructions:
http://wiki.openstreetmap.org/wiki/Nominatim/Installation#Installing_the_newest_version_of_osmosis

Sarah

On Tue, Feb 11, 2014 at 05:06:13PM +0000, Sarah Hoffmann wrote:
> On Tue, Feb 11, 2014 at 12:32:27PM +0100, mirko perillo wrote:
> > this is output running
> > 
> > ./utils/update.php --import-osmosis --no-npi
> > 
> > So I stopped it and the rerun produces this the output:
> > 
> > WARNING: resetting cache memory to 42
> > Exception in thread "Reference Handler"
> > java.lang.IllegalMonitorStateException
> >     at java.lang.Object.notifyAll(Native Method)
> >     at java.lang.ref.ReferenceQueue.enqueue(ReferenceQueue.java:68)
> >     at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:146)
> > 
> > Replication Delay is 863940
> > /usr/bin/osmosis --read-replication-interval
> > workingDirectory=/opt/Nominatim-2.1/settings --simplify-change
> > --write-xml-change /opt/Nominatim-2.1/data/osmosischange.osc
> > Feb 11, 2014 9:19:06 AM org.openstreetmap.osmosis.core.Osmosis run
> > INFO: Osmosis Version 0.40.1
> > Feb 11, 2014 9:19:06 AM org.openstreetmap.osmosis.core.Osmosis run
> > INFO: Preparing pipeline.
> > Feb 11, 2014 9:19:06 AM org.openstreetmap.osmosis.core.Osmosis run
> > INFO: Launching pipeline execution.
> > Feb 11, 2014 9:19:06 AM org.openstreetmap.osmosis.core.Osmosis run
> > INFO: Pipeline executing, waiting for completion.
> 
> So that means the problem is with osmosis. The IllegalMonitorStateException
> is throwing the script into an endless loop. The command that fails
> is most likely that one:
> 
> /usr/bin/osmosis -q --read-replication-lag workingDirectory=/opt/Nominatim-2.1/settings
> 
> Can you confirm that? If yes, try with the most recent osmosis version 
> (see http://wiki.openstreetmap.org/wiki/Osmosis)
> and maybe with different JVMs and different Java versions.
> 
> > Now is block on this line since this morning, can I kill him without
> > causing damages ?
> 
> Yes, you can kill that.
> 
> Sarah
> 
> > On 02/10/2014 05:31 PM, Sarah Hoffmann wrote:
> > >Hi,
> > >
> > >On Mon, Feb 10, 2014 at 09:29:46AM +0100, mirko perillo wrote:
> > >>I tried to set  --osm2pgsql-cache 500 parameter and I've the warning
> > >>anymore.
> > >>
> > >>I ran the script on friday, today is monday and the script hasn't output.
> > >>
> > >>This is my settings/state.txt content
> > >>
> > >># original OSM minutely replication sequence number 724874
> > >>timestamp=2014-01-31T21\:55\:02Z
> > >>sequenceNumber=330
> > >That should certainly work. Can you also post the output of
> > >configuration.txt?
> > >
> > >>any suggestions ? I think that the update script must have some
> > >>output messages to understand what the script does...but when I run
> > >>it I see anything
> > >Could you just run: ./utils/update.php --import-osmosis --no-npi
> > >
> > >It should do something useful and end immediately. If it hangs
> > >too, then something is going wrong with the php script. Confirm
> > >that you can connect to the URL given in configuration.txt. It
> > >would also help if you can find the last line that is executed
> > >before it hangs.
> > >
> > >Sarah
> > >
> > >>On 02/01/2014 05:25 PM, Sarah Hoffmann wrote:
> > >>>Hi,
> > >>>
> > >>>On Tue, Jan 28, 2014 at 10:36:52AM +0100, mirko perillo wrote:
> > >>>>Hi,
> > >>>>
> > >>>>I want to update data in my nominatim installation (2.1)
> > >>>>
> > >>>>So I followed the instructions of nominatim wiki
> > >>>>
> > >>>>1. I create settings/local.php file and I put in it
> > >>>>
> > >>>><?php
> > >>>>  @define('CONST_Replication_Url',
> > >>>>'http://download.geofabrik.de/europe/italy-updates');
> > >>>>  @define('CONST_Replication_MaxInterval', '40000');     // Process
> > >>>>each update separately, osmosis cannot merge multiple updates
> > >>>>  @define('CONST_Replication_Update_Interval', '86400');  // How
> > >>>>often upstream publishes diffs
> > >>>>  @define('CONST_Replication_Recheck_Interval', '900');   // How long
> > >>>>to sleep if no update found yet
> > >>>>
> > >>>>2. I move original settings/configuration.txt and settings/state.txt
> > >>>>and I run
> > >>>>
> > >>>>./utils/setup.php --osmosis-init
> > >>>>
> > >>>>(script ended OK and new configuration and state file are created)
> > >>>>
> > >>>>3. I run
> > >>>>
> > >>>>./utils/setup.php --create-functions --enable-diff-updates
> > >>>>
> > >>>>(script ended OK)
> > >>>>
> > >>>>4. I run
> > >>>>
> > >>>>  ./utils/update.php --import-osmosis-all --no-npi
> > >>>>
> > >>>>but on screen I see only this message (and nothing more)
> > >>>>
> > >>>>WARNING: resetting cache memory to 49
> > >>>That warning is worrying because osm2pgsql won't get enough cache
> > >>>memory. Try adding the parameter --osm2pgsql-cache 500
> > >>>
> > >>>>I checked data and they seems not updated
> > >>>>
> > >>>>Can somebody help me ?
> > >>>You should check the date in settings/state.txt. The updates for the
> > >>>Geofabrik excerpts are published only once a day. So it might be that
> > >>>there simply is no data available so far.
> > >>>
> > >>>Sarah
> >