[OSRM-talk] osrm-extract taking hours to complete

Daniel Patterson daniel at mapbox.com
Wed Mar 2 21:22:52 UTC 2016


Hi Frederik,

  Yes.  STXXL has a "memory" backend that avoids disk altogether.

    echo "disk=none,200000,memory" > .stxxl

  If you've got lots of RAM, this is the best way to make use of it.

daniel

> On Mar 2, 2016, at 1:19 PM, Frederik Ramm <frederik at remote.org> wrote:
> 
> Hi,
> 
> On 03/02/2016 09:03 PM, Bjorn Madsen wrote:
>> I added a high speed SSD and pointed the .stxxl towards that to deal
>> with the swap slowdown. That bought me a drop in processing time from 12
>> hrs -> 3-4 hrs.
>> 
>>    osrm at mat4:~/osrm-backend$ cat .stxxl 
>>    *disk=/mnt/tmp/stxxl,400000,syscall*
> 
> Since we're discussing this, I always wondered why I got STXXL messages
> even when running on a 256 GB RAM machine (could it not simply do
> everything in RAM there). Then tried to have the STXXL file on a ramdisk
> but failed because the Linux "tmpfs" doesn't support some IOCTL
> operation or so that STXXL wants to use. I ended up creating a sparse
> 200 GB file on the ram disk and loopback-mounting that to put an ext4
> file system on it, just to enable STXXL to put its swap file there.
> Surely better approaches exist?
> 
> Bye
> Frederik
> 
> -- 
> Frederik Ramm  ##  eMail frederik at remote.org  ##  N49°00'09" E008°23'33"
> 
> _______________________________________________
> OSRM-talk mailing list
> OSRM-talk at openstreetmap.org
> https://lists.openstreetmap.org/listinfo/osrm-talk




More information about the OSRM-talk mailing list