<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META http-equiv=Content-Type content="text/html; charset=utf-8">
<META content="MSHTML 6.00.5730.11" name=GENERATOR>
<STYLE></STYLE>
</HEAD>
<BODY bgColor=#ffffff>
<DIV><FONT face=Arial size=2>My personal feeling is that unless an area is
actively being worked on, then at present we shouldn't be importing coastline
data until we have a hardware / software platform which can deal with the volume
of data.</FONT></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV><FONT face=Arial size=2>I completed the upload of the UK coastline, which
OJW had started, I was unsure whether to do all of the Western Isles, but every
now and then I came across an area someone had added a road in, and so it was
hard to define a place where I should stop the coastline import, though I did
not import the Shetland Isles, coast, nor that for Northern & Southern
Ireland.</FONT></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV><FONT face=Arial size=2>David Groom</FONT></DIV>
<BLOCKQUOTE
style="PADDING-RIGHT: 0px; PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #000000 2px solid; MARGIN-RIGHT: 0px">
<DIV style="FONT: 10pt arial">----- Original Message ----- </DIV>
<DIV
style="BACKGROUND: #e4e4e4; FONT: 10pt arial; font-color: black"><B>From:</B>
<A title=raybooysen@rjb.za.net href="mailto:raybooysen@rjb.za.net">Ray
Booysen</A> </DIV>
<DIV style="FONT: 10pt arial"><B>To:</B> <A title=talk@openstreetmap.org
href="mailto:talk@openstreetmap.org">talk@openstreetmap.org</A> </DIV>
<DIV style="FONT: 10pt arial"><B>Sent:</B> Sunday, January 14, 2007 10:23
AM</DIV>
<DIV style="FONT: 10pt arial"><B>Subject:</B> Re: [OSM-talk] Server
slowness</DIV>
<DIV><BR></DIV>On that note, as the coastline import is pretty much automatic,
should we delete the coastlines for africa until we can move to the tile based
index. Its not very important to have the coastline import currently and
that should aleviate the issues for the time being. I've spoken to the
other Africa coastline importer (Firefishy) and he agrees that we should do
this. Between the two of us, large portions of the east and west of
Africa have been done, but both of these can be re-imported at a later date.
<BR><BR>Also, our imports finished right at the beginnning of January and we
have stopped imports until these other issues can be sorted out
first.<BR><BR>Comments? :)<BR><BR>Thanks<BR>Ray<BR><BR>
<DIV><SPAN class=gmail_quote>On 1/14/07, <B class=gmail_sendername>Nick
Hill</B> <<A href="mailto:nick@nickhill.co.uk">nick@nickhill.co.uk</A>>
wrote:</SPAN>
<BLOCKQUOTE class=gmail_quote
style="PADDING-LEFT: 1ex; MARGIN: 0pt 0pt 0pt 0.8ex; BORDER-LEFT: rgb(204,204,204) 1px solid">Looking
at the disc usage for the db, 10% of the hard disc was filled with
data<BR>between 29th Dec and 5th Jan. This represents 4Gb of data, including
indexes,<BR>which represents a 25% increase in the total OSM data set.
<BR><BR>I have taken a look at the Africa coastline. It is very detailed,
and looks like<BR>it even details mangrove swamps etc. So it is not beyond
possibility this<BR>increase in data set is caused by African coastline.
<BR><BR>This could cause a substantial hit for queries hitting Europe. Our
database<BR>currently narrows the index down on either lat or lon, not both.
Therefore,<BR>look-ups for Europe may require brute force searches to remove
the African <BR>coastline from the indexed dataset. That would impact
performance until we move<BR>to a tile based index.<BR><BR><BR>Nick Hill
wrote:<BR>> It is still worrying me how the database load has shot up on
30th December. This <BR>> inevitably causing slowness.<BR>><BR>>
When did the Africa coastline import run from/to?<BR>> How many points
were involved?<BR>> Was there any publicity of OSM on that day which
could have led to a significant <BR>> increase in users? Would this
result in this profile of usage ? (I think not but<BR>> prepared to
debate it).<BR>><BR>> Steve, did you make any changes to the API or DB
set-up around that time?<BR>><BR>><BR>><BR>> Andy Robinson
wrote:<BR>><BR>>> I thought it was probably the Africa Coastline
stuff too. We had nearly half<BR>>> a million node writes a day going
in earlier in the week, but as you point <BR>>> out that situation has
declined now. The only other thing that springs to<BR>>> mind is
Steve's mapnick db rendering. I'm assuming that's coming off the
db<BR>>> direct rather than using the last planet. If this is the case
I presume then <BR>>> it will take a while for the first run of tiles
to be completed, after that<BR>>> the load should drop of
course.<BR>><BR></BLOCKQUOTE></DIV></BLOCKQUOTE></BODY></HTML>