[OSM-dev] Memory Error on 16GB RAM

[Marco Boeringa]

Hi Leon,


I am actually wondering why you use an on-premise Overpass instance to 
return "all highways in Europe"...? I am certainly not an expert here, 
but I don't think Overpass was ever designed to handle that kind and 
size of request, and maybe even more so the potential client app you are 
using to visualize the data. I am thus also wondering what client app 
you are using to access the data?


E.g. considering you are talking about a local instance of the database, 
wouldn't it be a more logical fit, and direct route, to access the data 
in QGIS via an ODBC connection and write your queries in standard 
(PostGIS) SQL, instead of through Overpass?


Marco


Op 23-10-2018 om 09:17 schreef Leon Boehmer:
> Hi All,
>
> We are trying a query which returns all highways in Europe on our 
> on-premise Overpass. Unfortunately this query currently fails with 
> "runtime error: open64: 0 No error information /osm3s_v0.7.55_osm_base 
> Dispatcher_Client::request_read_and_idx::timeout. The server is 
> probably too busy to handle your request.". By setting maxsize to 5GB 
> and timeout to 900 we have managed to avoid other errors, but we see 
> this error far sooner than the 15 minutes we have given the query. We 
> have managed to trace this message to dispatcher_client.cc 
> <http://client.cc/>line 224 and see some sort of hardcoded timeout of 
> 100 (counter) x 300ms. Unfortunately my understanding of C++ doesn't 
> suffice to actually determine what the code is precisely waiting for 
> and how we can mitigate this particular condition.
> The VM Overpass is running on is equipped with 16GB of RAM as well as 
> SSDs and serves no other query at the same time, so we are pretty 
> confident it should be able to execute it in a timely fashion.
>
> Kind Regards,
>
> Leon Boehmer.
>
>
> _______________________________________________
> dev mailing list
> dev at openstreetmap.org
> https://lists.openstreetmap.org/listinfo/dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20181023/016bbf62/attachment.html>