<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Hi John,</div>
<div class="elementToProof"><span style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">First you will need Slurm. Second the rpms that have slurm in their name for mvapich2x
will use srun as their job launcher and not mpirun_rsh. Also, our user guide under section 5 has some other useful information that will be required for the information to show up
<a href="https://mvapich.cse.ohio-state.edu/userguide/osu-inam/#_running_example" id="LPlnk400881" class="OWAAutoLink" data-loopstyle="linkonly">
https://mvapich.cse.ohio-state.edu/userguide/osu-inam/#_running_example</a> . </span></div>
<div class="elementToProof"><span style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);"><br>
</span></div>
<div class="elementToProof"><span style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">-Matt</span></div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> evancervj <evancervj@cdac.in><br>
<b>Sent:</b> Wednesday, January 24, 2024 1:55 AM<br>
<b>To:</b> mvapich-discuss@lists.osu.edu <mvapich-discuss@lists.osu.edu>; Lieber, Matt <lieber.31@osu.edu><br>
<b>Subject:</b> Re: [Mvapich-discuss] Issue while Installation of Mvapich2-x-advanced for OSU-INAM</font>
<div> </div>
</div>
<div>
<div style="display:none!important; display:none; visibility:hidden; font-size:1px; color:#ffffff; line-height:1px; height:0px; max-height:0px; opacity:0; overflow:hidden">
HI Matt, Thanks for the suggestions. I had tried MVAPICH2X-Basic as well as using the flag --nodeps for MVAPICH2-X-Advanced. The installation is successful. I was able to see the fabric related information like network topology and the
</div>
<div style="display:none!important; display:none; visibility:hidden; font-size:1px; color:#ffffff; line-height:1px; height:0px; max-height:0px; opacity:0; overflow:hidden">
ZjQcmQRYFpfptBannerStart</div>
<div dir="ltr" lang="en" id="x_pfptBanner7p1nvgw" style="display:block!important; text-align:left!important; margin:16px 0px 16px 0px!important; padding:8px 16px 8px 16px!important; border-radius:4px!important; min-width:200px!important; background-color:#CFD3D7!important; background-color:#CFD3D7; border-top:4px solid #8c8e91!important; border-top:4px solid #8c8e91">
<div id="x_pfptBanner7p1nvgw" style="float:left!important; display:block!important; margin:0px 0px 1px 0px!important; max-width:600px!important">
<div id="x_pfptBanner7p1nvgw" style="display:block!important; visibility:visible!important; background-color:#CFD3D7!important; color:#000000!important; color:#000000; font-family:'Arial',sans-serif!important; font-family:'Arial',sans-serif; font-weight:bold!important; font-weight:bold; font-size:14px!important; line-height:18px!important; line-height:18px">
This Message Is From an External Sender </div>
<div id="x_pfptBanner7p1nvgw" style="display:block!important; visibility:visible!important; background-color:#CFD3D7!important; color:#000000!important; color:#000000; font-weight:normal; font-family:'Arial',sans-serif!important; font-family:'Arial',sans-serif; font-size:12px!important; line-height:18px!important; line-height:18px; margin-top:2px!important">
This message came from outside your organization. </div>
</div>
<div id="x_pfptBanner7p1nvgw" style="float:right!important; display:block!important; display:block; margin:0px 0px 0px 16px!important; text-align:right!important; width:fit-content!important">
<a id="x_pfptBanner7p1nvgw" href="https://us-phishalarm-ewt.proofpoint.com/EWT/v1/KGKeukY!vaQTHSdh4-YgClmS367kF4pSK3tDgFUeRd0RyZWCtZV5aEGNZOm8pIHYFghhwpDBVWq12d7S3Xzdu3qbTujN11_-CxQh3-aiw_9Ix3mF6fEoiM0s9FxNRDGQ7ZojIaw$" style="display:inline-block!important; text-decoration:none">
<div class="x_pfptPrimaryButton7p1nvgw" style="display:inline-block!important; display:inline-block; visibility:visible!important; opacity:1!important; color:#000000!important; color:#000000; font-family:'Arial',sans-serif!important; font-family:'Arial',sans-serif; font-size:14px!important; font-weight:normal!important; text-decoration:none!important; border-radius:2px!important; padding:7.5px 16px!important; margin:3px 0 3px 16px!important; white-space:nowrap!important; width:fit-content!important; border:1px solid #666666">
Report Suspicious </div>
</a></div>
<div style="clear:both!important; display:block!important; visibility:hidden!important; line-height:0!important; font-size:0.01px!important; height:0px">
</div>
</div>
<div style="display:none!important; display:none; visibility:hidden; font-size:1px; color:#ffffff; line-height:1px; height:0px; max-height:0px; opacity:0; overflow:hidden">
ZjQcmQRYFpfptBannerEnd</div>
<style>
<!--
#x_pfptBanner7p1nvgw
{display:block!important;
visibility:visible!important;
opacity:1!important;
background-color:#CFD3D7!important;
max-width:none!important;
max-height:none!important}
-->
</style><style type="text/css">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div><span style="font-size:12pt">HI Matt,</span> </div>
<div> </div>
<div><span style="font-size:12pt">Thanks for the suggestions. I had tried MVAPICH2X-Basic as well as using the flag --nodeps for MVAPICH2-X-Advanced. The installation is successful.
<span style="font-size:12pt">I was able to see the fabric related information like network topology and the run-time packet counter information on the INAM web interface.
</span></span></div>
<div><span style="font-size:12pt"><span style="font-size:12pt"> </span></span> </div>
<div><span style="font-size:12pt"><span style="font-size:12pt">However process level and MPI related information was not seen on the INAM web interface.
</span>To export MPI related information to OSU_INAM, I tried running application using MVAPICH2X, but the mpirun_rsh file was missing in the MVAPICH2X installation directory.
</span></div>
<div><span style="font-size:12pt">Both the MVAPICH2X packages(basic and advanced) did not provide the files like mpirun_rsh, mpirun.., to run applications.</span>
</div>
<div><span style="font-size:12pt"> </span> </div>
<div> </div>
<div><span style="font-size:12pt"><em>rpm -Uvh --nodeps mvapich2-x-advanced-mofed5.0-gnu4.8.5-slurm-2.3-1.el7.x86_64.rpm</em></span>
<br>
<span style="font-size:12pt"><em>Preparing... ################################# [100%]</em></span>
<br>
<span style="font-size:12pt"><em>Updating / installing...</em></span> <br>
<span style="font-size:12pt"><em> 1:mvapich2-x-advanced-mofed5.0-gnu4################################# [100%]</em></span>
</div>
<div> </div>
<div><span style="font-size:12pt"><em>ll /opt/mvapich2-x/gnu4.8.5/mofed5.0/advanced/slurm/bin/</em></span>
<br>
<span style="font-size:12pt"><em>total 132</em></span> <br>
<span style="font-size:12pt"><em>lrwxrwxrwx 1 root root 6 Jan 23 10:27 mpic++ -> mpicxx</em></span>
<br>
<span style="font-size:12pt"><em>-rwxr-xr-x 1 root root 10970 Jan 23 10:27 mpicc</em></span>
<br>
<span style="font-size:12pt"><em>-rwxr-xr-x 1 root root 12856 Jun 2 2021 mpichversion</em></span>
<br>
<span style="font-size:12pt"><em>-rwxr-xr-x 1 root root 10503 Jan 23 10:27 mpicxx</em></span>
<br>
<span style="font-size:12pt"><em>-rwxr-xr-x 1 root root 14218 Jan 23 10:27 mpif77</em></span>
<br>
<span style="font-size:12pt"><em>-rwxr-xr-x 1 root root 14218 Jan 23 10:27 mpif90</em></span>
<br>
<span style="font-size:12pt"><em>-rwxr-xr-x 1 root root 14278 Jun 2 2021 mpifort</em></span>
<br>
<span style="font-size:12pt"><em>-rwxr-xr-x 1 root root 12928 Jun 2 2021 mpiname</em></span>
<br>
<span style="font-size:12pt"><em>-rwxr-xr-x 1 root root 23256 Jun 2 2021 mpivars</em></span>
<br>
<span style="font-size:12pt"><em>-rwxr-xr-x 1 root root 3430 Jun 2 2021</em> parkill</span>
</div>
<div> </div>
<div><span style="font-size:12pt"> </span> </div>
<div><span style="font-size:12pt"> </span> </div>
<div><span style="font-size:12pt"><em>rpm -Uvh mvapich2-x-basic-mofed5.0-gnu4.8.5-slurm-2.3-1.el7.x86_64.rpm
</em><br>
<em>Preparing... ################################# [100%]</em><br>
<em>Updating / installing...</em><br>
<em> 1:mvapich2-x-basic-mofed5.0-gnu4.8.################################# [100%]</em><br>
<br>
<em>ll /opt/mvapich2-x/gnu4.8.5/mofed5.0/basic/slurm/bin/</em><br>
<em>total 132</em><br>
<em>lrwxrwxrwx 1 root root 6 Jan 24 11:54 mpic++ -> mpicxx</em><br>
<em>-rwxr-xr-x 1 root root 10756 Jan 24 11:54 mpicc</em><br>
<em>-rwxr-xr-x 1 root root 12856 May 20 2021 mpichversion</em><br>
<em>-rwxr-xr-x 1 root root 10324 Jan 24 11:54 mpicxx</em><br>
<em>-rwxr-xr-x 1 root root 14036 Jan 24 11:54 mpif77</em><br>
<em>-rwxr-xr-x 1 root root 14036 Jan 24 11:54 mpif90</em><br>
<em>-rwxr-xr-x 1 root root 14096 May 20 2021 mpifort</em><br>
<em>-rwxr-xr-x 1 root root 12928 May 20 2021 mpiname</em><br>
<em>-rwxr-xr-x 1 root root 23256 May 20 2021 mpivars</em><br>
<em>-rwxr-xr-x 1 root root 3430 May 20 2021 parkill</em><br>
<br>
</span></div>
<div><span style="font-size:12pt"> </span> </div>
<div><span style="font-size:12pt">I was able to access the fabric information on the OSU-INAM interface.
<span style="font-size:12pt">I wanted to leverage the OSU-INAM features to observe the process level and MPI level information as well, but failed because of the above mentioned issue. Any pointers on this will be helpful.
</span></span></div>
<div><span style="font-size:12pt"><span style="font-size:12pt"> </span></span> </div>
<div><span style="font-size:12pt"><span style="font-size:12pt">Also my current environment do not have Slurm or any other job scheduler installed. So Is Slurm necessary for OSU-INAM to export MPI level information?
<br>
</span></span></div>
<div><span style="font-size:12pt"><span style="font-size:12pt"> </span></span> </div>
<div><span style="font-size:12pt">Thanks<br>
</span></div>
<div><span style="font-size:12pt">John<br>
</span></div>
<div><span style="font-size:12pt"></span> </div>
<div><br>
On January 20, 2024 at 6:36 AM "Lieber, Matt" <lieber.31@osu.edu> wrote: </div>
<div style="">
<blockquote type="cite" style="margin-left:0px; padding-left:10px; border-left:solid 1px blue">
<div class="x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:#000000">
Hi John, </div>
<div class="x_elementToProof"><span style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:#000000">Sorry for the delay in getting back to you. There are multiple options that could fix this. If
you do not plan to use the sharp functionality adding the flag --nodeps should fix the issue you are seeing. Also MVAPICH2-X basic should also work with INAM. If you do wish to use sharp we will have to send a new rpm. Please let let us know how these options
work for you.</span> </div>
<div class="x_elementToProof"><span style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:#000000"><br>
</span></div>
<div class="x_elementToProof"><span style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:#000000">Thanks,</span>
</div>
<div class="x_elementToProof"><span style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:#000000">Matt</span>
</div>
<div id="x_appendonsend"> </div>
<hr>
<div id="x_divRplyFwdMsg" dir="ltr"><span style="font-size:11pt; color:#000000; font-family:Calibri,sans-serif"><strong>From:</strong> Mvapich-discuss <mvapich-discuss-bounces@lists.osu.edu> on behalf of V John via Mvapich-discuss <mvapich-discuss@lists.osu.edu><br>
<strong>Sent:</strong> Tuesday, January 16, 2024 7:41 AM<br>
<strong>To:</strong> mvapich-discuss@lists.osu.edu <mvapich-discuss@lists.osu.edu><br>
<strong>Subject:</strong> [Mvapich-discuss] Issue while Installation of Mvapich2-x-advanced for OSU-INAM</span>
<div> </div>
</div>
<div>
<div style="display:none; visibility:hidden; font-size:1px; color:#ffffff; line-height:1px; height:0px; max-height:0px; overflow:hidden">
Hi everyone, I'm trying to use OSU-INAM on our cluster with Mellanox-IB ConnectX-6 interconnect with machines having Centos7. 6 OS. I downloaded the osu-inam(osu-inam-mysql-1. 0-1. el7. x86_64. rpm) package matching the environment which also required
</div>
<div style="display:none; visibility:hidden; font-size:1px; color:#ffffff; line-height:1px; height:0px; max-height:0px; overflow:hidden">
</div>
<div class="x_x_default-style">Hi everyone, </div>
<div class="x_x_default-style"> </div>
<div class="x_x_default-style">I'm trying to use OSU-INAM on our cluster with Mellanox-IB ConnectX-6 interconnect with machines having Centos7.6 OS. I downloaded the osu-inam(osu-inam-mysql-1.0-1.el7.x86_64.rpm) package matching the environment which also required
MOFED 5+. So I installed MLNX_OFED_LINUX-5.0-1.0.0.0 package on the systems. </div>
<div class="x_x_default-style"> </div>
<div class="x_x_default-style"> </div>
<div class="x_x_default-style">Osu-Inam user-guide mentioned the requirement of Mvapich2-x-advanced for getting MPI usage related information. Hence, I tried to install MVAPICH2-X-advanced. The only binary matching the environment available on the Mvapich website
is mvapich2-x-advanced-mofed5.0-gnu4.8.5-slurm-2.3-1.el7.x86_64.rpm. The installation fails however due to dependency on libsharp_coll.so.4.
</div>
<div class="x_x_default-style"> </div>
<div class="x_x_default-style"><em>rpm -Uvh mvapich2-x-advanced-mofed5.0-gnu4.8.5-slurm-2.3-1.el7.x86_64.rpm
</em><br>
<em>error: Failed dependencies:</em> <br>
<em>libsharp_coll.so.4()(64bit) is needed by mvapich2-x-advanced-mofed5.0-gnu4.8.5-slurm-2.3-1.el7.x86_64</em>
</div>
<div class="x_x_default-style"><em><br>
</em></div>
<div class="x_x_default-style"><em><br>
</em></div>
<div class="x_x_default-style">The libsharp_coll library versions under the /opt/mellanox/sharp/lib directory created post the installation of MLNX_OFED_LINUX-5.0-1.0.0.0 misses the required version, libsharp_coll.so.4.
</div>
<div class="x_x_default-style"> </div>
<div class="x_x_default-style"><em>ls /opt/mellanox/sharp/lib | grep libsharp_coll.so</em>
<br>
<em>libsharp_coll.so</em> <br>
<em>libsharp_coll.so.5</em> <br>
<em>libsharp_coll.so.5.0.1</em> </div>
<div class="x_x_default-style"><em><br>
</em></div>
<div class="x_x_default-style"><em><br>
</em></div>
<div class="x_x_default-style">Is there a fix to this issue..? </div>
<div class="x_x_default-style"> </div>
<div class="x_x_default-style">Thanks </div>
<div class="x_x_default-style">John </div>
<div class="x_x_default-style">HPC Technologies Group </div>
<div class="x_x_default-style">C-DAC pune </div>
<br>
------------------------------------------------------------------------------------------------------------
<br>
[ C-DAC is on Social-Media too. Kindly follow us at: <br>
Facebook: <a href="https://urldefense.com/v3/__https://www.facebook.com/CDACINDIA__;!!KGKeukY!2KJphDWGFEcrgBZNFD0pyWfL_tLCH64l43moQyPTHdZMlRXL2sAhibE3ALe1Uzxh39TVZU1r-xrOX_sKpGycM_VAyzT0TQ$">
https://www.facebook.com/CDACINDIA</a> & Twitter: @cdacindia ] <br>
<br>
This e-mail is for the sole use of the intended recipient(s) and may <br>
contain confidential and privileged information. If you are not the <br>
intended recipient, please contact the sender by reply e-mail and destroy <br>
all copies and the original message. Any unauthorized review, use, <br>
disclosure, dissemination, forwarding, printing or copying of this email <br>
is strictly prohibited and appropriate legal action will be taken. <br>
------------------------------------------------------------------------------------------------------------
</div>
</blockquote>
<br>
</div>
<br>
------------------------------------------------------------------------------------------------------------
<br>
[ C-DAC is on Social-Media too. Kindly follow us at: <br>
Facebook: <a href="https://urldefense.com/v3/__https://www.facebook.com/CDACINDIA__;!!KGKeukY!xP_sp9xIt5MlF-mGh9nukFmdaGDl-o3tQ8iYqzLQpVIRRub9-TeUbJ4uW-GqCJC54Y1hZ38BrLaABtnLmSWZ$">
https://www.facebook.com/CDACINDIA</a> & Twitter: @cdacindia ] <br>
<br>
This e-mail is for the sole use of the intended recipient(s) and may <br>
contain confidential and privileged information. If you are not the <br>
intended recipient, please contact the sender by reply e-mail and destroy <br>
all copies and the original message. Any unauthorized review, use, <br>
disclosure, dissemination, forwarding, printing or copying of this email <br>
is strictly prohibited and appropriate legal action will be taken. <br>
------------------------------------------------------------------------------------------------------------
</div>
</body>
</html>