<html>
<head>
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>Hi Leon,</p>
<p><br>
</p>
<p>I am actually wondering why you use an on-premise Overpass
instance to return "all highways in Europe"...? I am certainly not
an expert here, but I don't think Overpass was ever designed to
handle that kind and size of request, and maybe even more so the
potential client app you are using to visualize the data. I am
thus also wondering what client app you are using to access the
data? <br>
</p>
<p><br>
</p>
<p>E.g. considering you are talking about a local instance of the
database, wouldn't it be a more logical fit, and direct route, to
access the data in QGIS via an ODBC connection and write your
queries in standard (PostGIS) SQL, instead of through Overpass?</p>
<p><br>
</p>
<p>Marco<br>
</p>
<br>
<div class="moz-cite-prefix">Op 23-10-2018 om 09:17 schreef Leon
Boehmer:<br>
</div>
<blockquote type="cite"
cite="mid:HE1PR08MB05860CE68F14E2530BEEC620A2F50@HE1PR08MB0586.eurprd08.prod.outlook.com">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
<div style="font-family: Calibri, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<span style="color: rgb(68, 68, 68); font-family: Arial,
Helvetica, sans-serif; font-size: 11pt; text-align: left;
background-color: rgb(255, 255, 255); display: inline
!important;">Hi All,</span></div>
<div style="color: rgb(0, 0, 0);"><font face="Arial, Helvetica,
sans-serif"><span style="font-size: 14.6667px;"><br
style="box-sizing: border-box; user-select: text; color:
rgb(68, 68, 68); text-align: left; background-color:
rgb(255, 255, 255);">
</span></font><span style="font-family: Arial, Helvetica,
sans-serif; font-size: 11pt; color: rgb(68, 68, 68);
text-align: left; background-color: rgb(255, 255, 255);
display: inline !important;">We are trying a query which
returns all highways in Europe on our on-premise Overpass.
Unfortunately this query currently fails with "runtime error:
open64: 0 No error information /osm3s_v0.7.55_osm_base
Dispatcher_Client::request_read_and_idx::timeout. The server
is probably too busy to handle your request.". By setting
maxsize to 5GB and timeout to 900 we have managed to avoid
other errors, but we see this error far sooner than the 15
minutes we have given the query. We have managed to trace this
message to dispatcher_</span><a href="http://client.cc/"
target="_blank" rel="noopener noreferrer" style="font-family:
-apple-system, BlinkMacSystemFont, "Segoe UI",
Roboto, Oxygen, Ubuntu, Cantarell, "Helvetica Neue",
"Apple Color Emoji", "Segoe UI Emoji",
"Segoe UI Symbol", "Meiryo UI", Arial,
sans-serif; font-size: 14px; box-sizing: border-box; margin:
0px; border: 0px solid; cursor: pointer; color: rgb(19, 103,
154); user-select: text; text-align: left; background-color:
rgb(255, 255, 255);" moz-do-not-send="true"><span
style="font-size: 11pt; font-family: Arial, Helvetica,
sans-serif;">client.cc</span></a><span style="font-family:
-apple-system, BlinkMacSystemFont, "Segoe UI",
Roboto, Oxygen, Ubuntu, Cantarell, "Helvetica Neue",
"Apple Color Emoji", "Segoe UI Emoji",
"Segoe UI Symbol", "Meiryo UI", Arial,
sans-serif; font-size: 14px; color: rgb(68, 68, 68);
text-align: left; background-color: rgb(255, 255, 255);
display: inline !important;"><span style="font-size: 11pt;
font-family: Arial, Helvetica, sans-serif;"> </span></span><span
style="font-family: Arial, Helvetica, sans-serif; font-size:
11pt; color: rgb(68, 68, 68); text-align: left;
background-color: rgb(255, 255, 255); display: inline
!important;">line 224 and see some sort of hardcoded timeout
of 100 (counter) x 300ms. Unfortunately my understanding of
C++ doesn't suffice to actually determine what the code is
precisely waiting for and how we can mitigate this particular
condition.</span><br style="box-sizing: border-box;
user-select: text; color: rgb(68, 68, 68); font-family:
-apple-system, BlinkMacSystemFont, "Segoe UI",
Roboto, Oxygen, Ubuntu, Cantarell, "Helvetica Neue",
"Apple Color Emoji", "Segoe UI Emoji",
"Segoe UI Symbol", "Meiryo UI", Arial,
sans-serif; font-size: 14px; text-align: left;
background-color: rgb(255, 255, 255)">
<span style="font-family: Arial, Helvetica, sans-serif;
font-size: 11pt; color: rgb(68, 68, 68); text-align: left;
background-color: rgb(255, 255, 255); display: inline
!important;">The VM Overpass is running on is equipped with
16GB of RAM as well as SSDs and serves no other query at the
same time, so we are pretty confident it should be able to
execute it in a timely fashion.</span><br style="box-sizing:
border-box; user-select: text; color: rgb(68, 68, 68);
font-family: -apple-system, BlinkMacSystemFont, "Segoe
UI", Roboto, Oxygen, Ubuntu, Cantarell, "Helvetica
Neue", "Apple Color Emoji", "Segoe UI
Emoji", "Segoe UI Symbol", "Meiryo
UI", Arial, sans-serif; font-size: 14px; text-align:
left; background-color: rgb(255, 255, 255)">
</div>
<div style="font-family: Calibri, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<span style="color: rgb(68, 68, 68); font-family: -apple-system,
BlinkMacSystemFont, "Segoe UI", Roboto, Oxygen,
Ubuntu, Cantarell, "Helvetica Neue", "Apple
Color Emoji", "Segoe UI Emoji", "Segoe UI
Symbol", "Meiryo UI", Arial, sans-serif;
font-size: 14px; text-align: left; background-color: rgb(255,
255, 255); display: inline !important"><br>
</span></div>
<div id="signature">
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt;
color:#000000; font-family:Calibri,Helvetica,sans-serif">
<span style="font-size: 11pt; font-family: Arial, Helvetica,
sans-serif;"></span>
<div><span style="font-family: Arial, Helvetica, sans-serif;
font-size: 11pt;">Kind Regards,</span><br>
</div>
<span style="font-size: 11pt; font-family: Arial, Helvetica,
sans-serif;"></span>
<div><span style="font-family:Calibri,Helvetica,sans-serif"><br>
</span></div>
<span style="font-size: 11pt; font-family: Arial, Helvetica,
sans-serif;"></span>
<div><span style="font-family: Arial, Helvetica, sans-serif;
font-size: 11pt;">Leon Boehmer.</span></div>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
dev mailing list
<a class="moz-txt-link-abbreviated" href="mailto:dev@openstreetmap.org">dev@openstreetmap.org</a>
<a class="moz-txt-link-freetext" href="https://lists.openstreetmap.org/listinfo/dev">https://lists.openstreetmap.org/listinfo/dev</a>
</pre>
</blockquote>
<br>
</body>
</html>