<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Hi Sylvain,</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Typically, this is caused by a non-standard CPU situation on your node. Are all tests being run on the same node or is there a pattern on the nodes that see failure? Can you send us the info from
<code>lscpu </code><code style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif;">on the failing run?</code></div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Thanks,</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Nat</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Mvapich-discuss <mvapich-discuss-bounces@lists.osu.edu> on behalf of Korzennik, Sylvain via Mvapich-discuss <mvapich-discuss@lists.osu.edu><br>
<b>Sent:</b> Sunday, September 8, 2024 13:17<br>
<b>To:</b> Panda, Dhabaleswar <panda@cse.ohio-state.edu><br>
<b>Cc:</b> Announcement about MVAPICH2 (MPI over InfiniBand, RoCE, Omni-Path, iWARP and EFA) Libraries developed at NBCL/OSU <mvapich-discuss@lists.osu.edu><br>
<b>Subject:</b> [Mvapich-discuss] Error parsing CPU mapping string/Invalid error code (-1) (error ring index 127 invalid)</font>
<div> </div>
</div>
<style>
<!--
#x_pfptBannerpi1dg16
{display:block!important;
visibility:visible!important;
opacity:1!important;
background-color:#CFD3D7!important;
max-width:none!important;
max-height:none!important}
-->
</style>
<div>
<div style="display:none!important; display:none; visibility:hidden; font-size:1px; color:#ffffff; line-height:1px; height:0px; max-height:0px; opacity:0; overflow:hidden">
While testing mvapich-3. 0 built with newest compilers (gcc 14. 2. 0, intel 2024. [12] and nvidia 24. [57]) I'm encountering the following error, when running a trivial set of tests (a hello world or a ring passing, in C or F90): Error parsing</div>
<div style="display:none!important; display:none; visibility:hidden; font-size:1px; color:#ffffff; line-height:1px; height:0px; max-height:0px; opacity:0; overflow:hidden">
ZjQcmQRYFpfptBannerStart</div>
<div dir="ltr" lang="en" id="x_pfptBannerpi1dg16" style="display:block!important; text-align:left!important; margin:16px 0px 16px 0px!important; padding:8px 16px 8px 16px!important; border-radius:4px!important; min-width:200px!important; background-color:#CFD3D7!important; background-color:#CFD3D7; border-top:4px solid #8c8e91!important; border-top:4px solid #8c8e91">
<div id="x_pfptBannerpi1dg16" style="float:left!important; display:block!important; margin:0px 0px 1px 0px!important; max-width:600px!important">
<div id="x_pfptBannerpi1dg16" style="display:block!important; visibility:visible!important; background-color:#CFD3D7!important; color:#000000!important; color:#000000; font-family:'Arial',sans-serif!important; font-family:'Arial',sans-serif; font-weight:bold!important; font-weight:bold; font-size:14px!important; line-height:18px!important; line-height:18px">
This Message Is From an External Sender </div>
<div id="x_pfptBannerpi1dg16" style="display:block!important; visibility:visible!important; background-color:#CFD3D7!important; color:#000000!important; color:#000000; font-weight:normal; font-family:'Arial',sans-serif!important; font-family:'Arial',sans-serif; font-size:12px!important; line-height:18px!important; line-height:18px; margin-top:2px!important">
This message came from outside your organization. </div>
</div>
<div id="x_pfptBannerpi1dg16" style="float:right!important; display:block!important; display:block; margin:0px 0px 0px 16px!important; text-align:right!important; width:fit-content!important">
<a id="x_pfptBannerpi1dg16" href="https://us-phishalarm-ewt.proofpoint.com/EWT/v1/KGKeukY!vYQd06kpI8bsxtaYUSEIektJFJ5vBzPCYaD0DvuWnT7JCN9VvgIJY-tvEUC_NChD3EajHidGrUC55Z9sMqyxhmLmA_aK_XmUKxVnQmd1iAeJoW4AxMfDlis3mvWLXSzDhdb2lA$" style="display:inline-block!important; text-decoration:none">
<div class="x_pfptPrimaryButtonpi1dg16" style="display:inline-block!important; display:inline-block; visibility:visible!important; opacity:1!important; color:#000000!important; color:#000000; font-family:'Arial',sans-serif!important; font-family:'Arial',sans-serif; font-size:14px!important; font-weight:normal!important; text-decoration:none!important; border-radius:2px!important; padding:7.5px 16px!important; margin:3px 0 3px 16px!important; white-space:nowrap!important; width:fit-content!important; border:1px solid #666666">
Report Suspicious </div>
</a></div>
<div style="clear:both!important; display:block!important; visibility:hidden!important; line-height:0!important; font-size:0.01px!important; height:0px">
</div>
</div>
<div style="display:none!important; display:none; visibility:hidden; font-size:1px; color:#ffffff; line-height:1px; height:0px; max-height:0px; opacity:0; overflow:hidden">
ZjQcmQRYFpfptBannerEnd</div>
<div dir="ltr">
<div dir="ltr">
<div class="x_gmail_default" style="font-size:small; color:rgb(53,28,117)">While testing mvapich-3.0 built with newest compilers (gcc 14.2.0, intel 2024.[12] and nvidia 24.[57]) I'm encountering the following error, when running a trivial set of tests (a hello
world or a ring passing, in C or F90):</div>
<div class="x_gmail_default" style="font-size:small; color:rgb(53,28,117)"><br>
</div>
<div class="x_gmail_default" style="font-size:small"><font face="monospace" color="#0000ff" style="">Error parsing CPU mapping string</font></div>
<font face="monospace" color="#0000ff"><span class="x_gmail_default" style="font-size:small; color:rgb(53,28,117)"></span>Invalid error code (-1) (error ring index 127 invalid)<br>
INTERNAL ERROR: invalid error code ffffffff (Ring Index out of range) in smpi_setaffinity:2791<br>
Abort(2141583) on node 0 (rank 0 in comm 0): Fatal error in PMPI_Init: Other MPI error, error stack:<br>
MPIR_Init_thread(175)...........:<br>
MPID_Init(597)..................:<br>
MPIDI_MVP_mpi_init_hook(268)....:<br>
MPIDI_MVP_CH4_set_affinity(3746):<br>
smpi_setaffinity(2791)..........: Error parsing CPU mapping string</font><br>
<div>
<div dir="ltr" class="x_gmail_signature">
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div dir="ltr">
<div dir="ltr"><font size="2"><span style="color:rgb(53,28,117)"><br>
</span></font></div>
<div><font size="2"><span style="color:rgb(53,28,117)"><span class="x_gmail_default" style="font-size:small; color:rgb(53,28,117)">This error creeps up somewhat randomly, the same job+compiler combo will work most of the time, but not all the time. </span></span></font></div>
<div><font size="2"><span style="color:rgb(53,28,117)"><span class="x_gmail_default" style="font-size:small; color:rgb(53,28,117)">Any suggestions on how to track this down?</span><br>
</span></font></div>
<div><font size="2"><span style="color:rgb(53,28,117)"><span class="x_gmail_default" style="font-size:small; color:rgb(53,28,117)"><br>
</span></span></font></div>
<div dir="ltr"><font size="2"><span style="color:rgb(53,28,117)"> </span></font><span style="color:rgb(53,28,117)">
<span class="x_gmail_default" style="font-size:small; color:rgb(53,28,117)">Thx, c</span>heers,</span><font size="2"><span style="color:rgb(53,28,117)"><br>
Sylvain<br>
--</span></font></div>
<div dir="ltr"><font size="2"><span style="color:rgb(53,28,117)"><br>
</span></font></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>