[Geocoding] update nominatim data

[mirko perillo]

Hi,

I installed new version of osmosis (the last one: 0.43.1),
modified my settings/local.php with new osmosis path

and run update script

./utils/update.php --import-osmosis --no-npi --osm2pgsql-cache 500
Exception in thread "Reference Handler" 
java.lang.IllegalMonitorStateException
     at java.lang.Object.notifyAll(Native Method)
     at java.lang.ref.ReferenceQueue.enqueue(ReferenceQueue.java:68)
     at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:146)

Replication Delay is 1036799
/opt/osmosis/bin/osmosis --read-replication-interval 
workingDirectory=/opt/Nominatim-2.1/settings --simplify-change 
--write-xml-change /opt/Nominatim-2.1/data/osmosischange.osc
Feb 13, 2014 9:15:11 AM org.openstreetmap.osmosis.core.Osmosis run
INFO: Osmosis Version 0.43.1
Feb 13, 2014 9:15:11 AM org.java.plugin.registry.xml.ManifestParser <init>
INFO: got SAX parser factory - 
org.apache.xerces.jaxp.SAXParserFactoryImpl at 6e1def
Feb 13, 2014 9:15:11 AM org.java.plugin.registry.xml.PluginRegistryImpl 
configure
INFO: configured, stopOnError=false, isValidating=true
Feb 13, 2014 9:15:11 AM org.java.plugin.registry.xml.PluginRegistryImpl 
register
INFO: plug-in and fragment descriptors registered - 1
Feb 13, 2014 9:15:11 AM org.java.plugin.standard.StandardPluginManager 
activatePlugin
INFO: plug-in started - 
org.openstreetmap.osmosis.core.plugin.Core at 0.0.0.42-6-gf39a160-dirty
Feb 13, 2014 9:15:11 AM org.openstreetmap.osmosis.core.Osmosis run
INFO: Preparing pipeline.
Feb 13, 2014 9:15:11 AM org.openstreetmap.osmosis.core.Osmosis run
INFO: Launching pipeline execution.
Feb 13, 2014 9:15:11 AM org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline executing, waiting for completion.

I'm sure that script uses new osmosis (/opt/osmosis/bin...)

Do you think run osmosis with jvm 1.7 can be a problem ?

On 02/12/2014 10:31 PM, Sarah Hoffmann wrote:
> Hi Mirko,
>
> after looking a bit closer into this, it looks like the osmosis
> version supplied with most distributions is simply too old.
> You need to install the newest version manually.
>
> There is now a new section in the installation instructions:
> http://wiki.openstreetmap.org/wiki/Nominatim/Installation#Installing_the_newest_version_of_osmosis
>
> Sarah
>
> On Tue, Feb 11, 2014 at 05:06:13PM +0000, Sarah Hoffmann wrote:
>> On Tue, Feb 11, 2014 at 12:32:27PM +0100, mirko perillo wrote:
>>> this is output running
>>>
>>> ./utils/update.php --import-osmosis --no-npi
>>>
>>> So I stopped it and the rerun produces this the output:
>>>
>>> WARNING: resetting cache memory to 42
>>> Exception in thread "Reference Handler"
>>> java.lang.IllegalMonitorStateException
>>>      at java.lang.Object.notifyAll(Native Method)
>>>      at java.lang.ref.ReferenceQueue.enqueue(ReferenceQueue.java:68)
>>>      at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:146)
>>>
>>> Replication Delay is 863940
>>> /usr/bin/osmosis --read-replication-interval
>>> workingDirectory=/opt/Nominatim-2.1/settings --simplify-change
>>> --write-xml-change /opt/Nominatim-2.1/data/osmosischange.osc
>>> Feb 11, 2014 9:19:06 AM org.openstreetmap.osmosis.core.Osmosis run
>>> INFO: Osmosis Version 0.40.1
>>> Feb 11, 2014 9:19:06 AM org.openstreetmap.osmosis.core.Osmosis run
>>> INFO: Preparing pipeline.
>>> Feb 11, 2014 9:19:06 AM org.openstreetmap.osmosis.core.Osmosis run
>>> INFO: Launching pipeline execution.
>>> Feb 11, 2014 9:19:06 AM org.openstreetmap.osmosis.core.Osmosis run
>>> INFO: Pipeline executing, waiting for completion.
>> So that means the problem is with osmosis. The IllegalMonitorStateException
>> is throwing the script into an endless loop. The command that fails
>> is most likely that one:
>>
>> /usr/bin/osmosis -q --read-replication-lag workingDirectory=/opt/Nominatim-2.1/settings
>>
>> Can you confirm that? If yes, try with the most recent osmosis version
>> (see http://wiki.openstreetmap.org/wiki/Osmosis)
>> and maybe with different JVMs and different Java versions.
>>
>>> Now is block on this line since this morning, can I kill him without
>>> causing damages ?
>> Yes, you can kill that.
>>
>> Sarah
>>
>>> On 02/10/2014 05:31 PM, Sarah Hoffmann wrote:
>>>> Hi,
>>>>
>>>> On Mon, Feb 10, 2014 at 09:29:46AM +0100, mirko perillo wrote:
>>>>> I tried to set  --osm2pgsql-cache 500 parameter and I've the warning
>>>>> anymore.
>>>>>
>>>>> I ran the script on friday, today is monday and the script hasn't output.
>>>>>
>>>>> This is my settings/state.txt content
>>>>>
>>>>> # original OSM minutely replication sequence number 724874
>>>>> timestamp=2014-01-31T21\:55\:02Z
>>>>> sequenceNumber=330
>>>> That should certainly work. Can you also post the output of
>>>> configuration.txt?
>>>>
>>>>> any suggestions ? I think that the update script must have some
>>>>> output messages to understand what the script does...but when I run
>>>>> it I see anything
>>>> Could you just run: ./utils/update.php --import-osmosis --no-npi
>>>>
>>>> It should do something useful and end immediately. If it hangs
>>>> too, then something is going wrong with the php script. Confirm
>>>> that you can connect to the URL given in configuration.txt. It
>>>> would also help if you can find the last line that is executed
>>>> before it hangs.
>>>>
>>>> Sarah
>>>>
>>>>> On 02/01/2014 05:25 PM, Sarah Hoffmann wrote:
>>>>>> Hi,
>>>>>>
>>>>>> On Tue, Jan 28, 2014 at 10:36:52AM +0100, mirko perillo wrote:
>>>>>>> Hi,
>>>>>>>
>>>>>>> I want to update data in my nominatim installation (2.1)
>>>>>>>
>>>>>>> So I followed the instructions of nominatim wiki
>>>>>>>
>>>>>>> 1. I create settings/local.php file and I put in it
>>>>>>>
>>>>>>> <?php
>>>>>>>   @define('CONST_Replication_Url',
>>>>>>> 'http://download.geofabrik.de/europe/italy-updates');
>>>>>>>   @define('CONST_Replication_MaxInterval', '40000');     // Process
>>>>>>> each update separately, osmosis cannot merge multiple updates
>>>>>>>   @define('CONST_Replication_Update_Interval', '86400');  // How
>>>>>>> often upstream publishes diffs
>>>>>>>   @define('CONST_Replication_Recheck_Interval', '900');   // How long
>>>>>>> to sleep if no update found yet
>>>>>>>
>>>>>>> 2. I move original settings/configuration.txt and settings/state.txt
>>>>>>> and I run
>>>>>>>
>>>>>>> ./utils/setup.php --osmosis-init
>>>>>>>
>>>>>>> (script ended OK and new configuration and state file are created)
>>>>>>>
>>>>>>> 3. I run
>>>>>>>
>>>>>>> ./utils/setup.php --create-functions --enable-diff-updates
>>>>>>>
>>>>>>> (script ended OK)
>>>>>>>
>>>>>>> 4. I run
>>>>>>>
>>>>>>>   ./utils/update.php --import-osmosis-all --no-npi
>>>>>>>
>>>>>>> but on screen I see only this message (and nothing more)
>>>>>>>
>>>>>>> WARNING: resetting cache memory to 49
>>>>>> That warning is worrying because osm2pgsql won't get enough cache
>>>>>> memory. Try adding the parameter --osm2pgsql-cache 500
>>>>>>
>>>>>>> I checked data and they seems not updated
>>>>>>>
>>>>>>> Can somebody help me ?
>>>>>> You should check the date in settings/state.txt. The updates for the
>>>>>> Geofabrik excerpts are published only once a day. So it might be that
>>>>>> there simply is no data available so far.
>>>>>>
>>>>>> Sarah