<div dir="ltr">Hi Jose,<div><br></div><div> That's correct, the published node binaries aren't built with STXXL support.</div><div><br></div><div> You can always use swap, but due to the memory access patterns that OSRM uses, it tends to be *incredibly* slow (what takes hours in RAM can take days or weeks with swap, depending on the amount). STXXL is greatly preferred when you're constrained for RAM.</div><div><br></div><div> The more RAM you can supply, the faster things will go.</div><div><br></div><div> These numbers are a bit out of date, but will give you a sense of what you'll need: <a href="https://github.com/Project-OSRM/osrm-backend/wiki/Disk-and-Memory-Requirements">https://github.com/Project-OSRM/osrm-backend/wiki/Disk-and-Memory-Requirements</a></div><div><br></div><div> I haven't run the whole planet for a while (here at Mapbox, we divide it up into the large disconnected geographic regions), so I don't have any more up-to-date numbers than that wiki page.</div><div><br></div><div>danie</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Mar 5, 2018 at 7:28 PM, Jose Florido <span dir="ltr"><<a href="mailto:joseflorido@gmail.com" target="_blank">joseflorido@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="auto">Thanks! So that means we cannot use the provided node binaries, right?<div dir="auto"><br></div><div dir="auto">Do you think that 192 gb of RAM + swap would be enough to be able to do preparation without STXXL enabled?</div><div dir="auto"><br></div><div dir="auto">Thanks!</div><span class="HOEnZb"><font color="#888888"><div dir="auto">Jose</div></font></span><div><div class="h5"><br><br><div class="gmail_quote" dir="auto"><div dir="ltr">On Mon, Mar 5, 2018, 19:09 Daniel Patterson <<a href="mailto:daniel@mapbox.com" rel="noreferrer" target="_blank">daniel@mapbox.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Jose,<div><br></div><div> 128GB is not enough to do *everything* in RAM - over 300GB of data is generated during some phases.</div><div><br></div><div> You'll probably want to do a custom build of OSRM and enable STXXL with `cmake -DENABLE_STXXL=ON ..`. This will build OSRM with the ability to do optimized data-to-disk swapping using the "libstxxl" library, which is faster than just using regular swap space.</div><div><br></div><div>daniel</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Mar 5, 2018 at 11:44 AM, Jose Florido <span dir="ltr"><<a href="mailto:joseflorido@gmail.com" rel="noreferrer noreferrer" target="_blank">joseflorido@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi!<br>
<br>
Is it possible to pre-process the planet file with OSRM 5.16.2 and<br>
only 128Gb ram? We do have a large SSD disk and pre processing doesn’t<br>
need to be super fast.<br>
<br>
Thanks!<br>
Jose<br>
<br>
______________________________<wbr>_________________<br>
OSRM-talk mailing list<br>
<a href="mailto:OSRM-talk@openstreetmap.org" rel="noreferrer noreferrer" target="_blank">OSRM-talk@openstreetmap.org</a><br>
<a href="https://lists.openstreetmap.org/listinfo/osrm-talk" rel="noreferrer noreferrer noreferrer" target="_blank">https://lists.openstreetmap.<wbr>org/listinfo/osrm-talk</a><br>
</blockquote></div><br></div>
______________________________<wbr>_________________<br>
OSRM-talk mailing list<br>
<a href="mailto:OSRM-talk@openstreetmap.org" rel="noreferrer noreferrer" target="_blank">OSRM-talk@openstreetmap.org</a><br>
<a href="https://lists.openstreetmap.org/listinfo/osrm-talk" rel="noreferrer noreferrer noreferrer" target="_blank">https://lists.openstreetmap.<wbr>org/listinfo/osrm-talk</a><br>
</blockquote></div></div></div></div>
<br>______________________________<wbr>_________________<br>
OSRM-talk mailing list<br>
<a href="mailto:OSRM-talk@openstreetmap.org">OSRM-talk@openstreetmap.org</a><br>
<a href="https://lists.openstreetmap.org/listinfo/osrm-talk" rel="noreferrer" target="_blank">https://lists.openstreetmap.<wbr>org/listinfo/osrm-talk</a><br>
<br></blockquote></div><br></div>