<div dir="ltr">Hi Peter,<div><br></div><div>If I put the pbf file in memory first, will it will be faster?</div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><b>Best Regards,</b><div><b>ZhiQiang ZHAO</b></div></div></div>
<br><div class="gmail_quote">On Fri, Jul 3, 2015 at 12:15 AM, Peter <span dir="ltr"><<a href="mailto:graphhopper@gmx.de" target="_blank">graphhopper@gmx.de</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div>Hi,<br>
<br>
Yes, more than 2 threads won't help much in practise as disc
access is the limiting resource for import (not CPU bound!). So
the default settings are already optimal in many cases.<span class=""><br>
<br>
> 1. what is the pool 1 and pool 2?<br>
<br></span>
That are the standard names of the
java.util.concurrent.ExecutorService I think. See PbfDecoder,
which is from osmosis.<span class=""><br>
<br>
<div><br>
</div>
<div>> For Europe download from geofabrik, this step take 50
minutes.</div>
<br></span>
You can try to put input (PBF) and output files (GH folder) on two
separate discs, preferable SSD.<br>
<br>
Regards,<br>
Peter<div><div class="h5"><br>
<br>
On 03.07.2015 01:39, John Zhao wrote:<br>
</div></div></div>
<blockquote type="cite"><div><div class="h5">
<div dir="ltr">Hi,
<div><br>
</div>
<div>I put parameter:</div>
<div>.put("osmreader.workerThreads", Math.max(2,
Runtime.getRuntime().availableProcessors()));</div>
<div><br>
</div>
<div>My CPU has 32 cores.</div>
<div>And I saw the log as below. It looks like this worked as we
thought.</div>
<div>But I have a few questions:</div>
<div>1. what is the pool 1 and pool 2?</div>
<div>2. what the load of machine is pretty low, like 2-5. I
thought it should be pretty high.</div>
<div>3. basically, this step is just convert pbf file to
internal osm entity object?</div>
<div><br>
</div>
<div>For Europe download from geofabrik, this step take 50
minutes.</div>
<div><br>
</div>
<div>
<div>22:33:23.967 [pool-1-thread-14] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>22:33:23.968 [pool-1-thread-6] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>22:33:23.968 [pool-1-thread-23] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>22:33:23.969 [pool-1-thread-5] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>22:33:23.969 [pool-1-thread-11] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>22:33:23.969 [pool-1-thread-12] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>22:33:23.970 [pool-1-thread-22] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>22:33:23.970 [pool-1-thread-2] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>22:33:23.970 [pool-1-thread-21] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>22:33:23.971 [pool-1-thread-25] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div><br>
</div>
<div>
<div>23:19:38.130 [pool-2-thread-5] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>23:19:38.142 [pool-2-thread-21] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>23:19:38.153 [pool-2-thread-13] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>23:19:38.164 [pool-2-thread-31] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>23:19:38.176 [pool-2-thread-12] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>23:19:38.186 [pool-2-thread-24] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>23:19:38.193 [pool-2-thread-4] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>23:19:38.203 [pool-2-thread-32] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>23:19:38.209 [pool-2-thread-22] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>23:19:38.218 [pool-2-thread-19] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>23:19:38.226 [pool-2-thread-3] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
<div>23:19:38.238 [pool-2-thread-27] DEBUG
c.g.reader.pbf.PbfBlobDecoder - Processing OSM primitive
group.</div>
</div>
<div>
<div><b>Best Regards,</b>
<div><b>ZhiQiang ZHAO</b></div>
</div>
</div>
</div>
</div>
<br>
<fieldset></fieldset>
<br>
</div></div><pre>_______________________________________________
GraphHopper mailing list
<a href="mailto:GraphHopper@openstreetmap.org" target="_blank">GraphHopper@openstreetmap.org</a>
<a href="https://lists.openstreetmap.org/listinfo/graphhopper" target="_blank">https://lists.openstreetmap.org/listinfo/graphhopper</a>
</pre>
</blockquote>
<br>
</div>
<br>_______________________________________________<br>
GraphHopper mailing list<br>
<a href="mailto:GraphHopper@openstreetmap.org">GraphHopper@openstreetmap.org</a><br>
<a href="https://lists.openstreetmap.org/listinfo/graphhopper" rel="noreferrer" target="_blank">https://lists.openstreetmap.org/listinfo/graphhopper</a><br>
<br></blockquote></div><br></div>