<p></p>
<p dir="auto">Did this issue only affect --slim import, not <strong>non-slim</strong> ones?</p>
<p dir="auto">I am asking because I noticed on <a href="https://wiki.openstreetmap.org/wiki/Osm2pgsql/benchmarks#Planet_(75.0GB_PBF,_2023-07-10)_on_HP_Z840_workstation,_512GB_DDR4_2133,_2x_Xeon_E5-2699v4_22C,_5x_Samsung_970_EVO_Plus_2TB_NVMe_RAID_0,_4x_Intel_OPTANE_P1600X_110GB_NVMe_RAID_0,_Ubuntu_22.04_~8h" rel="nofollow">some recent tests</a> with a full Planet import, that the <em>relation</em> stage loading is about 2-3 faster in <strong>non-slim</strong> mode (5k/s, versus 2k/s with --slim), where everything is stored in RAM.</p>
<p dir="auto">Now the fact that everything is stored in RAM may be the main cause of the speed up in relation processing, but I would in that case at least also have expected some speed up of the way processing. However, in reality, I see a consistently slightly slower (by about 10%-15%) way loading stage (+/- 83k/s to 70k/s) in <strong>non-slim</strong> mode, which slightly surprises me as unexpected with all data in RAM.</p>
<p dir="auto">Note that this is a comparison with --slim mode import using also a --flat-node file, so maybe the specific structure of --flat-node is in fact more efficient than pulling nodes from RAM for way building on high performance NVMe backed hardware??</p>
<p style="font-size:small;-webkit-text-size-adjust:none;color:#666;">—<br />Reply to this email directly, <a href="https://github.com/openstreetmap/osm2pgsql/pull/2007#issuecomment-1644557665">view it on GitHub</a>, or <a href="https://github.com/notifications/unsubscribe-auth/AA6353UIT5I4PJYMXG25WYLXRGIFRANCNFSM6AAAAAA2RJ5NAQ">unsubscribe</a>.<br />You are receiving this because you are subscribed to this thread.<img src="https://github.com/notifications/beacon/AA6353VVL2ACCIBLNEDAMWTXRGIFRA5CNFSM6AAAAAA2RJ5NASWGG33NNVSW45C7OR4XAZNMJFZXG5LFINXW23LFNZ2KUY3PNVWWK3TUL5UWJTTCAX2WC.gif" height="1" width="1" alt="" /><span style="color: transparent; font-size: 0; display: none; visibility: hidden; overflow: hidden; opacity: 0; width: 0; height: 0; max-width: 0; max-height: 0; mso-hide: all">Message ID: <span><openstreetmap/osm2pgsql/pull/2007/c1644557665</span><span>@</span><span>github</span><span>.</span><span>com></span></span></p>
<script type="application/ld+json">[
{
"@context": "http://schema.org",
"@type": "EmailMessage",
"potentialAction": {
"@type": "ViewAction",
"target": "https://github.com/openstreetmap/osm2pgsql/pull/2007#issuecomment-1644557665",
"url": "https://github.com/openstreetmap/osm2pgsql/pull/2007#issuecomment-1644557665",
"name": "View Pull Request"
},
"description": "View this Pull Request on GitHub",
"publisher": {
"@type": "Organization",
"name": "GitHub",
"url": "https://github.com"
}
}
]</script>