[GraphHopper] Running out of heap space when starting webapp with large .osm.pbf

[Muhammad Babar]

I know this is not the solution just check if its worked. You should still
wait for Emux reply as he is the King of GHopper!

On Fri, Oct 10, 2014 at 5:47 PM, Muhammad Babar <babar.magma at gmail.com>
wrote:

> Have you tried to set largeHeap = true in application tag (manifest)?
>
> On Fri, Oct 10, 2014 at 5:29 PM, Nate Atkinson <nate at gaia-movement.org>
> wrote:
>
>> Hi,
>>
>> I'm evaluating GraphHopper for integration with some software at work--
>> specifically quickly generating geojson path for routes with up to 40
>> stops. Using a small .osm.pbf file downloaded from geofabrik, it looks
>> like GraphHopper will fit our needs well, and I'm excited to use it.
>>
>> When I try to use a larger .osm.pbf file, like the 6.2 GB file for North
>> America, I get an error when trying to start.
>>
>> Here's what happens:
>>
>> nate at NateTestEnv:~/graphhopper$ java -jar
>> graphhopper-web-0.3-with-dep.jar -Xmx7g jetty.resourcebase=webapp
>> config=config-example.properties
>> osmreader.osm=./north-america-latest.osm.pbf
>>
>> 2014-10-09 13:02:38,259 [main] INFO  com.graphhopper.GraphHopper -
>> version 0.3|2014-05-13T11:36:30+0200 (3,5,3,2,2)
>> 2014-10-09 13:02:38,275 [main] INFO  com.graphhopper.GraphHopper - graph
>> LevelGraphStorage|car|MMAP_STORE_SYNC|2D|,,,,, details:edges:0(0),
>> nodes:0(0), name: - (0), geo:0(0),
>>
>> bounds:1.7976931348623157E308,-1.7976931348623157E308,1.7976931348623157E308,-1.7976931348623157E308
>> 2014-10-09 13:02:38,300 [main] INFO  com.graphhopper.GraphHopper - start
>> creating graph from ./north-america-latest.osm.pbf
>> 2014-10-09 13:02:38,300 [main] INFO  com.graphhopper.GraphHopper - using
>> LevelGraphStorage|car|MMAP_STORE_SYNC|2D|,,,,, memory:totalMB:120,
>> usedMB:8
>> 2014-10-09 13:10:22,788 [main] INFO  graphhopper.reader.OSMReader -
>> 500 000 (preprocess), osmIdMap:6 959 244 (86MB) totalMB:723, usedMB:297
>>
>> ....
>>
>> 2014-10-09 13:13:01,288 [main] INFO  graphhopper.reader.OSMReader -
>> 10 000 000 (preprocess), osmIdMap:137 558 252 (1630MB) totalMB:1895,
>> usedMB:1726
>> Exception in thread "pool-1-thread-2" java.lang.OutOfMemoryError: GC
>> overhead limit exceeded
>>         at
>>
>> gnu.trove.list.array.TLongArrayList.ensureCapacity(TLongArrayList.java:186)
>>         at
>> gnu.trove.list.array.TLongArrayList.add(TLongArrayList.java:221)
>>         at
>>
>> com.graphhopper.reader.pbf.PbfBlobDecoder.processWays(PbfBlobDecoder.java:286)
>>         at
>>
>> com.graphhopper.reader.pbf.PbfBlobDecoder.processOsmPrimitives(PbfBlobDecoder.java:372)
>>         at
>>
>> com.graphhopper.reader.pbf.PbfBlobDecoder.runAndTrapExceptions(PbfBlobDecoder.java:388)
>>         at
>> com.graphhopper.reader.pbf.PbfBlobDecoder.run(PbfBlobDecoder.java:406)
>> ....
>>
>>
>> I get a similar message for a second thread. The process stays running,
>> but I see no CPU activity in top.
>>
>> The system is running Debian wheezy. I tested with openjdk 1.6 and 1.7.
>>
>> So, how can I get this running with a large network? I'm sure there's a
>> command line switch or config setting somewhere that I've missed due to
>> my inexperience with java.
>>
>> Best regards,
>>
>> Nate Atkinson
>>
>> _______________________________________________
>> GraphHopper mailing list
>> GraphHopper at openstreetmap.org
>> https://lists.openstreetmap.org/listinfo/graphhopper
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/graphhopper/attachments/20141010/73ea2ab7/attachment.html>