[OSM-talk] State of the NameFinder
David Earl
david at frankieandshadow.com
Wed Aug 26 12:58:34 BST 2009
On 26/08/2009 12:44, Peteris Krisjanis wrote:
> Anyway, so far I have heard about two efforts of getting NameFinder
> running again. First one is just performance improvement for old one
> (done by David Earl)
I have been trying to rebuild the index, but the first two attempts
failed (well, the second worked but the changes meant it took an
impracticably long time(*)).
I was going to start a third attempt today (it's best to start on a
Wednesday with a fresh planet file).
Beyond getting the index updated using the existing technology, my next
step is to try using postgres instead of mysql to (hopefully) increase
the search speed (I use self-joins a lot and these should be faster in
postgres; there may also be scope beyond that for replacing my low level
word search algorithm with postgres' flexible free text searching but
still retaining the multiple variations the system copes with at present).
While the current index is January, that's from daily updates. The last
time the index was completely reloaded was February 2008, so the amount
of data has increased enormously since then, and that means everything
takes a lot longer.
David
(*) I was trying InnoDB tables, but the overhead on these was
tremendous, and the load process was taking order of magnitude longer.
More information about the talk
mailing list