[OSRM-talk] Updating a map

Julien Coupey osm at coupey.fr
Sun Aug 12 17:03:21 UTC 2018


Hi Didier,

The exclude flag feature introduced a while back in OSRM might explain a 
change in RAM requirements for the same OSM file. If you don't need that 
feature, you can disable the associated extra work/memory usage by 
setting an empty "excludable" list in the profile at:

https://github.com/Project-OSRM/osrm-backend/blob/master/profiles/car.lua#L122-L126

Hope that helps
Julien

On 10/08/2018 09:34, Didier Doumerc wrote:
> I have only 12 GB of RAM but when I installed the previous file version, 
> it was ok with only 4 GB or RAM.
> 
> Is there anyway way to successfully prepare the files ? Perhaps by 
> downloading them ready yet ?
> 
> Thanks for your answer.
> 
> Didier
> 
> Le jeu.09/08/18 à 18:15, Sayer, Bryan a écrit :
> 
>> When I had that problem it was due to lack of memory. For the United 
>> States, I had to have 64 GB of memory prepare, though I was doing it 
>> through a Stata interface, not directly.
>> ------------------------------------------------------------------------
>> *From:*Didier Doumerc <doumerc.d at adimep.com <mailto:doumerc.d at adimep.com>>
>> *Sent:*Thursday, August 9, 2018 11:53:39 AM
>> *To:*osrm-talk at openstreetmap.org <mailto:osrm-talk at openstreetmap.org>
>> *Subject:*[OSRM-talk] Updating a map
>> Hi,
>>
>> I need help for updating the map file. Here is what I get when I run 
>> osrm-prepare france-latest.osrm. It stops at 90%
>>
>> [info] Input file: france-latest.osrm
>> [info] Profile: profile.lua
>> [info] Threads: 8
>> [info] Loading edge-expanded graph representation
>> [info] Opening france-latest.osrm.ebg
>> [info] Reading 25874228 edges from the edge based graph
>> [info] Done reading edges
>> [STXXL-MSG] STXXL v1.4.1 (prerelease/Release)
>> [STXXL-ERRMSG] Warning: no config file found.
>> [STXXL-ERRMSG] Using default disk configuration.
>> [STXXL-MSG] Disk '/var/tmp/stxxl' is allocated, space: 1000 MiB, I/O 
>> implementation: syscall autogrow delete_on_exit queue=0 devid=0
>> merged 51783408 edges out of 103496912
>> contractor finished initalization
>> initializing elimination PQ ...ok
>> preprocessing 13952773 nodes .... 10% . 20% . 30% . 40% . 50% . 60% . 
>> [flush 9336408 nodes]  70% . 80% . 90% .
>>
>>
>>
>> Before, I run osrm-extract france-latest/osm.pbf
>>
>>
>> [info] Input file: france-latest.osm.pbf
>> [info] Profile: profile.lua
>> [info] Threads: 8
>> [info] Using script profile.lua
>> [STXXL-MSG] STXXL v1.4.1 (prerelease/Release)
>> [STXXL-ERRMSG] Warning: no config file found.
>> [STXXL-ERRMSG] Using default disk configuration.
>> [STXXL-MSG] Disk '/var/tmp/stxxl' is allocated, space: 1000 MiB, I/O 
>> implementation: syscall autogrow delete_on_exit queue=0 devid=0
>> [info] Parsing in progress..
>> [info] input file generated by osmium/1.8.0
>> [info] timestamp: 2018-08-05T20:00:03Z
>> [info] Using turn restrictions
>> [info] Found 3 exceptions to turn restrictions:
>> [info]   motorcar
>> [info]   motor_vehicle
>> [info]   vehicle
>> [info] Parsing finished after 914.304 seconds
>> [info] Raw input contains 387758183 nodes, 57191546 ways, and 521319 
>> relations, and 0 unknown entities
>> [extractor] Sorting used nodes        ... ok, after 8.97724s
>> [extractor] Erasing duplicate nodes   ... ok, after 5.16838s
>> [extractor] Sorting all nodes         ... ok, after 270.95s
>> [extractor] Building node id map      ... ok, after 146.325s
>> [extractor] setting number of nodes   ... ok
>> [extractor] Confirming/Writing used nodes     ... ok, after 84.6342s
>> [info] Processed 36442184 nodes
>> [extractor] Sorting edges by start    ... ok, after 46.7546s
>> [extractor] Setting start coords      ... ok, after 188.624s
>> [extractor] Sorting edges by target   ... ok, after 47.2029s
>> [extractor] Computing edge weights    ... ok, after 201.467s
>> [extractor] Sorting edges by renumbered start ... ok, after 47.6069s
>> [extractor] Writing used egdes       ... ok, after 33.4863s
>> [extractor] setting number of edges   ... ok
>> [info] Processed 37971544 edges
>> [extractor] Sorting used ways         ... ok, after 3.42604s
>> [extractor] Sorting 34351 restriction. by from... ok, after 0.078667s
>> [extractor] Fixing restriction starts ... ok, after 1.32651s
>> [extractor] Sorting restrictions. by to  ... ok, after 0.048604s
>> [extractor] Fixing restriction ends   ... ok, after 1.28459s
>> [info] usable restrictions: 31935
>> [extractor] writing street name index ... ok, after 0.159635s
>> [info] extraction finished after 2046.13s
>> [info] Generating edge-expanded graph representation
>> [info]  - 31935 restrictions.
>> [info] Importing n = 36442184 nodes
>> [info]  - 17000 bollard nodes, 41647 traffic lights
>> [info]  and 37971544 edges
>> [info] Graph loaded ok and has 37971544 edges
>> . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100%
>> [info] Node compression ratio: 0.166043
>> [info] Edge compression ratio: 0.19941
>> . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100%
>> [info] Generated 37961020 nodes in edge-expanded graph
>> [info] generating edge-expanded edges
>> . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100%
>> [info] Generated 37961020 edge based nodes
>> [info] Node-based graph contains 13952773 edges
>> [info] Edge-expanded graph ...
>> [info]   contains 25874228 edges
>> [info]   skips 26910 turns, defined by 31859 restrictions
>> [info]   skips 11264858 U turns
>> [info]   skips 18504 turns over barriers
>> [info] Timing statistics for edge-expanded graph:
>> [info] Renumbering edges: 0.239598s
>> [info] Generating nodes: 10.5262s
>> [info] Generating edges: 44.5756s
>> [info] building r-tree ...
>> [info] large component [6711]=13836854
>> [info] SCC run took: 1.89227s
>> [info] constructing r-tree of 37961020 edge elements build on-top of 
>> 36442184 coordinates
>> [info] finished r-tree construction in 23.796 seconds
>> [info] writing node map ...
>> [extractor] Writing edge-based-graph egdes       ... ok, after 3.98042s
>> [info] Processed 25874228 edges
>> [info] Expansion  : 274152 nodes/sec and 104966 edges/sec
>> [info] To prepare the data for routing, run: ./osrm-prepare 
>> france-latest.osrm
>>
>> [STXXL-ERRMSG] Removing disk file: /var/tmp/stxxl
>> logout
>> Saving session...
>> ...copying shared history...
>> ...saving history...truncating history files...
>> ...completed.
>>
>>
>> Thanks for your help.
>>
>> Kind regards.
>>
>> Didier
>>
>> ****WARNING**** This information may be confidential. It is intended 
>> only for the addressee(s) identified above. If you are not the 
>> addressee(s), or an employee or agent of the addressee(s), please note 
>> that any dissemination, distribution, or copying of this communication 
>> is strictly prohibited. If you have received this information in 
>> error, please destroy the information and notify the sender of the 
>> error. Thank you. _______________________________________________
>> OSRM-talk mailing list
>> OSRM-talk at openstreetmap.org <mailto:OSRM-talk at openstreetmap.org>
>> https://lists.openstreetmap.org/listinfo/osrm-talk
> 
> 
> 
> _______________________________________________
> OSRM-talk mailing list
> OSRM-talk at openstreetmap.org
> https://lists.openstreetmap.org/listinfo/osrm-talk
> 



More information about the OSRM-talk mailing list