<!-- BaNnErBlUrFlE-BoDy-start -->
<!-- Preheader Text : BEGIN -->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">
Thanks Reyhan, This sounds good to me. Best Regards Amit R From: Motlagh, Reyhan <motlagh. 2@ osu. edu> Sent: Tuesday, January 14, 2025 9: 52 AM To: Amit Ruhela <aruhela@ tacc. utexas. edu>; Announcement about MVAPICH (MPI over InfiniBand,</div>
<!-- Preheader Text : END -->
<!-- Email Banner : BEGIN -->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;max-height:0px;opacity:0;overflow:hidden;">ZjQcmQRYFpfptBannerStart</div>
<!--[if ((ie)|(mso))]>
<table border="0" cellspacing="0" cellpadding="0" width="100%" style="padding: 16px 0px 16px 0px; direction: ltr" lang="en"><tr><td>
<table border="0" cellspacing="0" cellpadding="0" style="padding: 0px 10px 5px 6px; width: 100%; border-radius:4px; border-top:4px solid #8c8e91;background-color:#CFD3D7;"><tr><td valign="top">
<table align="left" border="0" cellspacing="0" cellpadding="0" style="padding: 4px 8px 4px 8px">
<tr><td style="color:#000000; font-family: 'Arial', sans-serif; font-weight:bold; font-size:14px; direction: ltr">
This Message Is From an External Sender
</td></tr>
<tr><td style="color:#000000; font-weight:normal; font-family: 'Arial', sans-serif; font-size:12px; direction: ltr">
This message came from outside your organization.
</td></tr>
</table>
<![if ie]><br clear="all"><![endif]>
<table align="right" border="0" cellspacing="0" cellpadding="0" style="padding: 4px 0px 4px 0px"><tr>
<td style="direction: ltr"> <a target="_blank" href="https://us-phishalarm-ewt.proofpoint.com/EWT/v1/KGKeukY!vwQf0kaND6YApRdx344E2cqRw_j5i6Xx5GGYtEi0loxLFjYg43LAHzgh6nGMSGFIgW728Tn9mWgmRf5ik59pYFzHbm8RYaztKw7bpZRcww5NiKUgMHR0GmKOVOLaz7cznI6bL-_pHk34TfUnn94S1Q$" style="mso-padding-alt: 7.5px; padding: 7.5px; border-radius: 2px; border: 1.5px solid #666666; "><strong style="font-weight: normal; color: #000000; text-decoration: none; font-family: 'Arial', sans-serif; font-size:14px; line-height: 40px; "> Report Suspicious </strong></a> </td>
</tr></table>
</td></tr></table>
</td></tr></table>
<![endif]-->
<![if !((ie)|(mso))]>
<div dir="ltr" lang="en" id="pfptBannerrqaxh97" style="all: revert !important; display:block !important; text-align: left !important; margin:16px 0px 16px 0px !important; padding:8px 16px 8px 16px !important; border-radius: 4px !important; min-width: 200px !important; background-color: #CFD3D7 !important; background-color: #CFD3D7; border-top: 4px solid #8c8e91 !important; border-top: 4px solid #8c8e91;">
<div id="pfptBannerrqaxh97" style="all: unset !important; float:left !important; display:block !important; margin: 0px 0px 1px 0px !important; max-width: 600px !important;">
<div id="pfptBannerrqaxh97" style="all: unset !important; display:block !important; visibility: visible !important; background-color: #CFD3D7 !important; color:#000000 !important; color:#000000; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-weight:bold !important; font-weight:bold; font-size:14px !important; line-height:18px !important; line-height:18px">
This Message Is From an External Sender
</div>
<div id="pfptBannerrqaxh97" style="all: unset !important; display:block !important; visibility: visible !important; background-color: #CFD3D7 !important; color:#000000 !important; color:#000000; font-weight:normal; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-size:12px !important; line-height:18px !important; line-height:18px; margin-top:2px !important;">
This message came from outside your organization.
</div>
</div>
<div id="pfptBannerrqaxh97" style="all: unset !important; float: right !important; display: block !important; display: block; margin: 0px 0px 0px 16px !important; text-align: right !important; width: fit-content !important;">
<a id="pfptBannerrqaxh97" href="https://us-phishalarm-ewt.proofpoint.com/EWT/v1/KGKeukY!vwQf0kaND6YApRdx344E2cqRw_j5i6Xx5GGYtEi0loxLFjYg43LAHzgh6nGMSGFIgW728Tn9mWgmRf5ik59pYFzHbm8RYaztKw7bpZRcww5NiKUgMHR0GmKOVOLaz7cznI6bL-_pHk34TfUnn94S1Q$"
style="all: unset !important; display: inline-block !important; text-decoration: none">
<div class="pfptPrimaryButtonrqaxh97" style="display: inline-block !important; display: inline-block; visibility: visible !important; opacity: 1 !important; color: #000000 !important; color: #000000; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-size: 14px !important; font-weight: normal !important; text-decoration: none !important; border-radius: 2px !important; padding: 7.5px 16px !important; margin: 3px 0 3px 16px !important; white-space: nowrap !important; width: fit-content !important;
border: 1px solid #666666">
Report Suspicious
</div>
</a>
</div>
<div style="clear: both !important; display: block !important; visibility: hidden !important; line-height: 0 !important; font-size: 0.01px !important; height: 0px"> </div>
</div>
<![endif]>
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;max-height:0px;opacity:0;overflow:hidden;">ZjQcmQRYFpfptBannerEnd</div>
<!-- Email Banner : END -->
<!-- BaNnErBlUrFlE-BoDy-end -->
<html>
<head><!-- BaNnErBlUrFlE-HeAdEr-start -->
<style>
#pfptBannerrqaxh97 { all: revert !important; display: block !important;
visibility: visible !important; opacity: 1 !important;
background-color: #CFD3D7 !important;
max-width: none !important; max-height: none !important }
.pfptPrimaryButtonrqaxh97:hover, .pfptPrimaryButtonrqaxh97:focus {
background-color: #adb0b4 !important; }
.pfptPrimaryButtonrqaxh97:active {
background-color: #8c8e91 !important; }
</style>
<!-- BaNnErBlUrFlE-HeAdEr-end -->
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);">
Thanks Reyhan,</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);">
This sounds good to me.</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);">
Best Regards</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 11pt; color: rgb(0, 0, 0);">
Amit R</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Motlagh, Reyhan <motlagh.2@osu.edu><br>
<b>Sent:</b> Tuesday, January 14, 2025 9:52 AM<br>
<b>To:</b> Amit Ruhela <aruhela@tacc.utexas.edu>; Announcement about MVAPICH (MPI over InfiniBand, RoCE, Omni-Path, Slingshot, iWARP and EFA) Libraries developed at NBCL/OSU <mvapich-discuss@lists.osu.edu>; Panda, Dhabaleswar <panda@cse.ohio-state.edu>; You,
Zhi-Qiang <zyou@osc.edu><br>
<b>Subject:</b> Re: Failed to unpack MVAPICH-Plus RPM</font>
<div> </div>
</div>
<style>
<!--
@font-face
{font-family:"Cambria Math"}
@font-face
{font-family:Calibri}
@font-face
{font-family:Aptos}
p.x_MsoNormal, li.x_MsoNormal, div.x_MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif}
a:link, span.x_MsoHyperlink
{color:blue;
text-decoration:underline}
span.x_EmailStyle19
{font-family:"Aptos",sans-serif;
color:windowtext}
.x_MsoChpDefault
{font-size:10.0pt}
@page WordSection1
{margin:1.0in 1.0in 1.0in 1.0in}
div.x_WordSection1
{}
ol
{margin-bottom:0in}
ul
{margin-bottom:0in}
-->
</style>
<div lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="x_WordSection1">
<p class="x_MsoNormal"><span style="font-size:11.0pt">Hi,</span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt">Amit - We are working on documenting some commonly used deprecated envs and their replacements in our readthedocs, but a comprehensive list would be thousands of variables. Between our
<a href="https://urldefense.com/v3/__https://mvapich-docs.readthedocs.io/en/latest/cvar.html__;!!KGKeukY!xa2HO6TnGc0hhJ6FGJg5hy5KSrSkT_YPHpndO2wy0qZBiev6Ig0Vfn6vdHRV-FTLKZHLQGDAf_fCoR5mVt8pgENYopQm6BsgZA$" originalsrc="https://mvapich-docs.readthedocs.io/en/latest/cvar.html" shash="Js/SJ9N89m3cbdKiYsKGB2qeYgJBjvwILWDcloNXGAFXXa5ueASke3F1jtjHp7xdcjNMdRUodtWS8Z3AbM7ApWh0+y4OiUTlH3LTirl3Iej6sZ+na4V/y7kPYw/avxg0s8bFfKJc1SBCLzqmAl3z6/k8syUVXSHS0TWsSKPnkVw=">
readthedocs</a>, “ucx_info -c”, and “fi_info -e” you should be able to see all available depending on the netmod used.</span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt">Karen and ZQ – Thanks! I’m able to login now, we’re looking into the issue.</span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt"><br>
Reyhan</span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt"> </span></p>
<div id="x_mail-editor-reference-message-container">
<div>
<div style="border:none; border-top:solid #B5C4DF 1.0pt; padding:3.0pt 0in 0in 0in">
<p class="x_MsoNormal" style="margin-bottom:12.0pt"><b><span style="color:black">From:
</span></b><span style="color:black">Amit Ruhela <aruhela@tacc.utexas.edu><br>
<b>Date: </b>Tuesday, January 14, 2025 at 10:01</span><span style="font-family:"Arial",sans-serif; color:black"> </span><span style="color:black">AM<br>
<b>To: </b>Motlagh, Reyhan <motlagh.2@osu.edu>, Announcement about MVAPICH (MPI over InfiniBand, RoCE, Omni-Path, Slingshot, iWARP and EFA) Libraries developed at NBCL/OSU <mvapich-discuss@lists.osu.edu>, Panda, Dhabaleswar <panda@cse.ohio-state.edu>, You,
Zhi-Qiang <zyou@osc.edu><br>
<b>Subject: </b>Re: Failed to unpack MVAPICH-Plus RPM</span></p>
</div>
<div>
<p class="x_MsoNormal" style=""><span style="font-size:1.0pt; color:white">Hi Reyhan, Is it possible to get a matrix listing environment variables that have been deprecated and what environment variables replace/recommended for the older ones? Thanks Amit Ruhela
From: Mvapich-discuss <mvapich-discuss-bounces+aruhela=tacc.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">utexas.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">edu@</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">lists.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">osu.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">edu></span></p>
</div>
<div>
<p class="x_MsoNormal" style=""><span style="font-size:1.0pt; color:white"></span></p>
</div>
<div>
<p class="x_MsoNormal"><span style="font-size:11.0pt; color:black">Hi Reyhan,</span></p>
</div>
<div>
<p class="x_MsoNormal"><span style="font-size:11.0pt; color:black"> </span></p>
</div>
<div>
<p class="x_MsoNormal"><span style="font-size:11.0pt; color:black">Is it possible to get a matrix listing environment variables that have been deprecated and what environment variables replace/recommended for the older ones?</span></p>
</div>
<div>
<p class="x_MsoNormal"><span style="font-size:11.0pt; color:black"> </span></p>
</div>
<div>
<p class="x_MsoNormal"><span style="font-size:11.0pt; color:black">Thanks</span></p>
</div>
<div>
<p class="x_MsoNormal"><span style="font-size:11.0pt; color:black">Amit Ruhela</span></p>
</div>
<div>
<p class="x_MsoNormal"><span style="font-size:11.0pt; color:black"> </span></p>
</div>
<div class="x_MsoNormal" align="center" style="text-align:center">
<hr size="0" width="100%" align="center">
</div>
<div id="x_divRplyFwdMsg">
<p class="x_MsoNormal"><b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:black">From:</span></b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:black"> Mvapich-discuss <mvapich-discuss-bounces+aruhela=tacc.utexas.edu@lists.osu.edu>
on behalf of You, Zhi-Qiang via Mvapich-discuss <mvapich-discuss@lists.osu.edu><br>
<b>Sent:</b> Monday, January 13, 2025 5:15 PM<br>
<b>To:</b> Motlagh, Reyhan <motlagh.2@osu.edu>; Announcement about MVAPICH (MPI over InfiniBand, RoCE, Omni-Path, Slingshot, iWARP and EFA) Libraries developed at NBCL/OSU <mvapich-discuss@lists.osu.edu>; Panda, Dhabaleswar <panda@cse.ohio-state.edu><br>
<b>Subject:</b> Re: [Mvapich-discuss] Failed to unpack MVAPICH-Plus RPM</span> </p>
<div>
<p class="x_MsoNormal"> </p>
</div>
</div>
<p><span style="font-size:11.0pt">Hi Reyhan,</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
<p style="margin-bottom:12.0pt"><span style="font-size:11.0pt">Thank you for the prompt reply. I have tested the new RPM but the issue remains.</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt">Regarding the account reactivation, please contact OSC help:
<u><span style="color:#467886"><a href="mailto:oschelp@osc.edu"><span style="color:#467886">oschelp@osc.edu</span></a></span></u><br>
<br>
Best,</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt">ZQ</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
<div id="x_x_mail-editor-reference-message-container">
<div style="border:none; border-top:solid windowtext 1.0pt; padding:3.0pt 0in 0in 0in; border-color:currentcolor currentcolor">
<p style="margin-bottom:12.0pt"><b><span style="color:black">From: </span></b><span style="color:black">Motlagh, Reyhan <motlagh.2@osu.edu><br>
<b>Date: </b>Tuesday, January 14, 2025 at 6:01</span><span style="font-family:"Arial",sans-serif; color:black"> </span><span style="color:black">AM<br>
<b>To: </b>You, Zhi-Qiang <zyou@osc.edu>, Announcement about MVAPICH (MPI over InfiniBand, RoCE, Omni-Path, Slingshot, iWARP and EFA) Libraries developed at NBCL/OSU <mvapich-discuss@lists.osu.edu>, Panda, Dhabaleswar <panda@cse.ohio-state.edu><br>
<b>Subject: </b>Re: Failed to unpack MVAPICH-Plus RPM</span><span style="font-size:10.0pt"></span></p>
</div>
<p><span style="font-size:11.0pt">Hi ZQ,</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt">By default we build with the version of slurm included with the OS package manager (slurm 22 for rhel9). It looks like Cardinal uses slurm 24, so this may be causing some incompatibilities. Can you try out the RPM below to
see if that’s the resolution? We’re also looking into this on our end.</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
<p><u><span style="font-size:11.0pt; color:#467886"><a href="https://mvapich.cse.ohio-state.edu/download/mvapich/plus/4.0/cuda/UCX/mofed24.10/mvapich-plus-4.0-cuda12.4.rhel9.ofed24.10.ucx.gcc13.2.0.slurm24-4.0-1.x86_64.rpm" originalsrc="https://mvapich.cse.ohio-state.edu/download/mvapich/plus/4.0/cuda/UCX/mofed24.10/mvapich-plus-4.0-cuda12.4.rhel9.ofed24.10.ucx.gcc13.2.0.slurm24-4.0-1.x86_64.rpm" shash="vIDzUuHDpAPKZM+So3ak44YhmuYwNApoyECxgA7onCkt54KWcM6BF+E4Rwjif20o15IaVSeLGxtd8qjM+2XZoW2cDaCo15lmkhkSfnhHVoyPlsFYRDqfWElkV8mafRJh40MJUpKZLJDW+kuDDCEwd1F9wwaIDex2ZCg/LKCM7to="><span style="color:#467886">https://mvapich.cse.ohio-state.edu/download/mvapich/plus/4.0/cuda/UCX/mofed24.10/mvapich-plus-4.0-cuda12.4.rhel9.ofed24.10.ucx.gcc13.2.0.slurm24-4.0-1.x86_64.rpm</span></a></span></u><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt">It looks like my osc account has been disabled, to help with this troubleshooting, who can I reach out to for reactivation (I assume this is all on Cardinal)? Username is rmotlagh.<br>
<br>
Regarding your questions:</span><span style="font-size:10.0pt"></span></p>
<ol start="1" type="1" style="margin-top:0in">
<li class="x_MsoNormal" style=""><span style="font-size:11.0pt">Yes, we are hoping to have MVAPICH 4.0 released within the month.</span><span style="font-size:10.0pt"></span></li><li class="x_MsoNormal" style=""><span style="font-size:11.0pt">We have unified redundant envs (like having separate envs for HIP and CUDA) and made naming conventions more consistent for our CVARs. So yes, replace that with MVP_ENABLE_GPU</span><span style="font-size:10.0pt"></span></li><li class="x_MsoNormal" style=""><span style="font-size:11.0pt">Some of these are done in the netmod layer now. You can set IB devices with “UCX_NET_DEVICES=mlx5_0:1” and “UCX_SOCKADDR_TLS_PRIORITY=rdmacm” (rdmacm may require a new rpm with --with-rdmacm ucx
configure flag, I will update the website rpms to allow for this if it passes our testing). MVP_HOMOGENEOUS_CLUSTER’s equivalent is irrelevant now, performance is good regardless of this flag.</span><span style="font-size:10.0pt"></span></li></ol>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt">Best,</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt">Reyhan</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
<div id="x_x_mail-editor-reference-message-container">
<div style="border:none; border-top:solid windowtext 1.0pt; padding:3.0pt 0in 0in 0in; border-color:currentcolor currentcolor">
<p style="margin-bottom:12.0pt"><b><span style="color:black">From: </span></b><span style="color:black">Mvapich-discuss <mvapich-discuss-bounces@lists.osu.edu> on behalf of You, Zhi-Qiang via Mvapich-discuss <mvapich-discuss@lists.osu.edu><br>
<b>Date: </b>Saturday, January 11, 2025 at 9:32</span><span style="font-family:"Arial",sans-serif; color:black"> </span><span style="color:black">PM<br>
<b>To: </b>Panda, Dhabaleswar <panda@cse.ohio-state.edu>, Announcement about MVAPICH (MPI over InfiniBand, RoCE, Omni-Path, Slingshot, iWARP and EFA) Libraries developed at NBCL/OSU <mvapich-discuss@lists.osu.edu><br>
<b>Subject: </b>Re: [Mvapich-discuss] Failed to unpack MVAPICH-Plus RPM</span><span style="font-size:10.0pt"></span></p>
</div>
<p><span style="font-size:11.0pt">Hi DK,</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt">Thank you for the prompt fix. The RPM is now functioning correctly. However, I encountered the following error while running a simple ping-pong MPI test over two nodes:</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"><br>
slurmstepd: error: pmijobid missing in fullinit command</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"><br>
I suspected this might be due to PMI incompatibility. I referred to <u><span style="color:#467886"><a href="https://urldefense.com/v3/__https:/mvapich-docs.readthedocs.io/en/latest/cvar.html*mvapich-environment-variables__;Iw!!KGKeukY!3fo-CIZdjSLr3Qr4T-N801LdCwjo-3DZiuA5KjZOvLaCn4id5M3xni5dWZHrZEnZrHIvm_FdrzIPC23DUe4941agsuMkFyC1$" originalsrc="https://urldefense.com/v3/__https:/mvapich-docs.readthedocs.io/en/latest/cvar.html*mvapich-environment-variables__;Iw!!KGKeukY!3fo-CIZdjSLr3Qr4T-N801LdCwjo-3DZiuA5KjZOvLaCn4id5M3xni5dWZHrZEnZrHIvm_FdrzIPC23DUe4941agsuMkFyC1$" shash="U/bxGlkOHPe/cMR/Fn2OZl0MMkYGENvsVRyv0O5NN7UousJrM/Wk79MNlTD1rzfovYdzlYJdhLnoizXJtpeQiH3q38oz8HJeikEaKaiJZpBGSvIf9D+IWdI7coWn3XlNl6d6r/fnv4v46KfeAa2eF5cFTIhBt1VTEjibSn5xwJc="><span style="color:#467886">this
documentation</span></a></span></u> and learned about setting MVP_PMI_VERSION to 2 to align with our SLURM configuration. However, the issue persists. I also checked the output of mpichversion -a and confirmed that the --with-pmi=pmi2 option is enabled, leading
me to conclude that this is not a PMI compatibility issue.</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt">Additionally, I have a few related questions:</span><span style="font-size:10.0pt"></span></p>
<ol start="1" type="1" style="margin-top:0in">
<li class="x_MsoNormal" style=""><span style="font-size:11.0pt">Will there be an MVAPICH 4.0 release, or will it be replaced by the MVAPICH-Plus CPU-only version?</span><span style="font-size:10.0pt"></span></li><li class="x_MsoNormal" style=""><span style="font-size:11.0pt">The documentation linked above lists many environment variables that I haven’t encountered before when using MVAPICH2-GDR. Are these new variables specific to MVAPICH 4.0? Are variables like MV2_USE_CUDA/MVP_USE_CUDA
still available, or should they be replaced with MVP_ENABLE_GPU?</span><span style="font-size:10.0pt"></span></li><li class="x_MsoNormal" style=""><span style="font-size:11.0pt">Could you help confirm if the following variables are still supported in MVAPICH?</span><span style="font-size:10.0pt"></span></li></ol>
<ol start="3" type="1" style="margin-top:0in">
<ul type="circle" style="margin-top:0in">
<li class="x_MsoNormal" style=""><span style="font-size:11.0pt">MVP_USE_RDMA_CM</span><span style="font-size:10.0pt"></span></li></ul>
</ol>
<ol start="3" type="1" style="margin-top:0in">
<ul type="circle" style="margin-top:0in">
<li class="x_MsoNormal" style=""><span style="font-size:11.0pt">MVP_HOMOGENEOUS_CLUSTER</span><span style="font-size:10.0pt"></span></li></ul>
</ol>
<ol start="3" type="1" style="margin-top:0in">
<ul type="circle" style="margin-top:0in">
<li class="x_MsoNormal" style=""><span style="font-size:11.0pt">MVP_IBA_HCA</span><span style="font-size:10.0pt"></span></li></ul>
</ol>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt">Thank you for your time and assistance!</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt">Best regards,</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt">ZQ</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
<div id="x_x_mail-editor-reference-message-container">
<div style="border:none; border-top:solid windowtext 1.0pt; padding:3.0pt 0in 0in 0in; border-color:currentcolor currentcolor">
<p style="margin-bottom:12.0pt"><b><span style="color:black">From: </span></b><span style="color:black">Panda, Dhabaleswar <panda@cse.ohio-state.edu><br>
<b>Date: </b>Saturday, January 11, 2025 at 3:14</span><span style="font-family:"Arial",sans-serif; color:black"> </span><span style="color:black">AM<br>
<b>To: </b>You, Zhi-Qiang <zyou@osc.edu>, Announcement about MVAPICH (MPI over InfiniBand, RoCE, Omni-Path, Slingshot, iWARP and EFA) Libraries developed at NBCL/OSU <mvapich-discuss@lists.osu.edu><br>
<b>Subject: </b>RE: Failed to unpack MVAPICH-Plus RPM</span><span style="font-size:10.0pt"></span></p>
</div>
<p><span style="font-size:11.0pt; font-family:"Calibri",sans-serif">Hi ZQ,</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt; font-family:"Calibri",sans-serif">As we have communicated with you separately, a new RPM has been uploaded. Please try this version and let us know whether you see any additional issues.</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt; font-family:"Calibri",sans-serif">DK</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span><span style="font-size:10.0pt"></span></p>
<div style="border:none; border-top:solid windowtext 1.0pt; padding:3.0pt 0in 0in 0in; border-color:currentcolor currentcolor">
<p><b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> Mvapich-discuss <mvapich-discuss-bounces@lists.osu.edu>
<b>On Behalf Of </b>You, Zhi-Qiang via Mvapich-discuss<br>
<b>Sent:</b> Thursday, January 2, 2025 1:54 PM<br>
<b>To:</b> mvapich-discuss@lists.osu.edu<br>
<b>Subject:</b> [Mvapich-discuss] Failed to unpack MVAPICH-Plus RPM</span><span style="font-size:10.0pt"></span></p>
</div>
<p> <span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt">Hello,</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt">I downloaded the MVAPICH-Plus 4.0 RPM from the following link:</span><span style="font-size:10.0pt"></span></p>
<p><u><span style="font-size:11.0pt; color:#467886"><a href="https://mvapich.cse.ohio-state.edu/download/mvapich/plus/4.0/cuda/UCX/mofed5.0/mvapich-plus-4.0-cuda12.4.rhel9.ofed24.10.ucx.gcc13.2.0.slurm-4.0-1.x86_64.rpm" originalsrc="https://mvapich.cse.ohio-state.edu/download/mvapich/plus/4.0/cuda/UCX/mofed5.0/mvapich-plus-4.0-cuda12.4.rhel9.ofed24.10.ucx.gcc13.2.0.slurm-4.0-1.x86_64.rpm" shash="NvBIrw1I+0mt4XteDxj6Ms45mr1jdyUJ/nvcbnPbvuoLHyfZHUwmzZ8rRG/ZwCrp0ROlHyspFIDjnX2HGGatQSMZ3UTOU+A+5shvpsyFr55BfTH4OR2v9rBZvgKDeZg/iy/B5MswK2LAfHJbarWbL0kZvEZ7vD1bxOGERUc9zNo="><span style="color:#467886">https://mvapich.cse.ohio-state.edu/download/mvapich/plus/4.0/cuda/UCX/mofed5.0/mvapich-plus-4.0-cuda12.4.rhel9.ofed24.10.ucx.gcc13.2.0.slurm-4.0-1.x86_64.rpm</span></a></span></u><span style="font-size:11.0pt">,
but I encountered an issue when trying to unpack it using cpio. The process failed with the error:</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"><br>
cpio: premature end of file</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt">I have no issues unpacking other RPMs, so it seems this file might be corrupted. Could you please check and confirm?</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt">Thank you,</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt">ZQ</span><span style="font-size:10.0pt"></span></p>
<p><span style="font-size:11.0pt"> </span><span style="font-size:10.0pt"></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>