[Geocoding] geocoding limit on local Nominatim instance?

[Xiang, Aster]

Thank you all for your help. I think the limit problem is solved.

I used a python script to send the request to the server locally. I originally was reading the source file from a remote server, then I moved the source file to the machine where OSM server is installed, and read it locally, then I don't see the limit problem.

So I guess the limit was some sort of HTTP limit on the remote server. But it is working fine now!

Thanks!

Aster 

-----Original Message-----
Could you perhaps at least mention the sort of script?  Are we talking PHP or perl ?  How are you accessing your data source?  Directly in the DB or are you calling the api itself using CURL or the like?  If I were to make this in php, a few things I would definitely set are these:

ob_implicit_flush();
declare(ticks = 5); //

/* make it or break it */
error_reporting(E_ALL);
ini_set("memory_limit","500M");

/* Keep it running */
error_reporting(E_ALL);
ini_set("max_input_time", "0");
//set_time_limit(0);
ini_set('max_execution_time', 0);

The information is too scarce to be able to help effectively.

Glenn
-----Original Message-----
From: twain47 at gmail.com [mailto:twain47 at gmail.com] On Behalf Of Brian Quinion
Sent: Monday, June 10, 2013 4:36 PM
To: Xiang, Aster
Cc: geocoding at openstreetmap.org
Subject: Re: [Geocoding] geocoding limit on local Nominatim instance?

There are no limits on the standard install.

There are options that can be turned on for rate limiting but you would have had to install memcache and change the following setting @define('CONST_ConnectionBucket_MemcacheServerAddress', false); which isn't even documented in the install guide.

I would suggest you look at the calling script and see if you have any leaks.

--
 Brian

On 10 June 2013 17:17, Xiang, Aster <asterxiang at wustl.edu> wrote:
> Hi All,
>
>
>
> I installed a local Nominatim instance on Ubuntu 12.04. I am trying to 
> do bulk geocoding about 30,000 addresses. I split the data into 10,000 
> per batch, and I found out the script stopped after the first 4300 
> records geocoded, without reporting any errors. So then I thought 
> maybe it was because of some limit, I split the first 10,000 batch 
> into 5,000 addresses per batch, and then I see the script stopped 
> after the first 3200 records, no errors.
>
>
>
> I am wondering if there is any settings on the limit of my local 
> Nominatim server? I appreciate any help on this!
>
>
>
> Thanks,
>
>
>
> Aster
>
>
> _______________________________________________
> Geocoding mailing list
> Geocoding at openstreetmap.org
> http://lists.openstreetmap.org/listinfo/geocoding
>