<head><!-- BaNnErBlUrFlE-HeAdEr-start -->
<style>
#pfptBannerrftpadh { all: revert !important; display: block !important;
visibility: visible !important; opacity: 1 !important;
background-color: #CFD3D7 !important;
max-width: none !important; max-height: none !important }
.pfptPrimaryButtonrftpadh:hover, .pfptPrimaryButtonrftpadh:focus {
background-color: #adb0b4 !important; }
.pfptPrimaryButtonrftpadh:active {
background-color: #8c8e91 !important; }
</style>
<!-- BaNnErBlUrFlE-HeAdEr-end -->
</head><!-- BaNnErBlUrFlE-BoDy-start -->
<!-- Preheader Text : BEGIN -->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">
Hello Nat, Awesome, thanks for the info! I will retry and let you know later. Also, to do the ./configure --with-device=ch3: nemesis have no problem, but when we do afterward will have two error: 1st: when it goes to /src/mpid/ch3/channels/nemesis/netmod/tcp/tcp_init. c
</div>
<!-- Preheader Text : END -->
<!-- Email Banner : BEGIN -->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">ZjQcmQRYFpfptBannerStart</div>
<!--[if ((ie)|(mso))]>
<table border="0" cellspacing="0" cellpadding="0" width="100%" style="padding: 16px 0px 16px 0px; direction: ltr" lang="en"><tr><td>
<table border="0" cellspacing="0" cellpadding="0" style="padding: 0px 10px 5px 6px; width: 100%; border-radius:4px; border-top:4px solid #8c8e91;background-color:#CFD3D7;"><tr><td valign="top">
<table align="left" border="0" cellspacing="0" cellpadding="0" style="padding: 4px 8px 4px 8px">
<tr><td style="color:#000000; font-family: 'Arial', sans-serif; font-weight:bold; font-size:14px; direction: ltr">
This Message Is From an External Sender
</td></tr>
<tr><td style="color:#000000; font-weight:normal; font-family: 'Arial', sans-serif; font-size:12px; direction: ltr">
This message came from outside your organization.
</td></tr>
</table>
<![if ie]><br clear="all"><![endif]>
<table align="right" border="0" cellspacing="0" cellpadding="0" style="padding: 4px 0px 4px 0px"><tr>
<td style="direction: ltr"> <a target="_blank" href="https://us-phishalarm-ewt.proofpoint.com/EWT/v1/KGKeukY!vYQd06jLTGauQXIZtEFNe8JMImpKSxxkSqDPe1PW8zOxJQCCXShEwIGBZ93sMXoSAdNeJmHgoHrSgsiB6qOw2KJJzfqxF2cw8gIASww2b0NnuJk3iibz2-yWFi96GlJfHNj1zA$" style="mso-padding-alt: 7.5px; padding: 7.5px; border-radius: 2px; border: 1.5px solid #666666; "><strong style="font-weight: normal; color: #000000; text-decoration: none; font-family: 'Arial', sans-serif; font-size:14px; line-height: 40px; "> Report Suspicious </strong></a> </td>
</tr></table>
</td></tr></table>
</td></tr></table>
<![endif]-->
<![if !((ie)|(mso))]>
<div dir="ltr" lang="en" id="pfptBannerrftpadh" style="all: revert !important; display:block !important; text-align: left !important; margin:16px 0px 16px 0px !important; padding:8px 16px 8px 16px !important; border-radius: 4px !important; min-width: 200px !important; background-color: #CFD3D7 !important; background-color: #CFD3D7; border-top: 4px solid #8c8e91 !important; border-top: 4px solid #8c8e91;">
<div id="pfptBannerrftpadh" style="all: unset !important; float:left !important; display:block !important; margin: 0px 0px 1px 0px !important; max-width: 600px !important;">
<div id="pfptBannerrftpadh" style="all: unset !important; display:block !important; visibility: visible !important; background-color: #CFD3D7 !important; color:#000000 !important; color:#000000; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-weight:bold !important; font-weight:bold; font-size:14px !important; line-height:18px !important; line-height:18px">
This Message Is From an External Sender
</div>
<div id="pfptBannerrftpadh" style="all: unset !important; display:block !important; visibility: visible !important; background-color: #CFD3D7 !important; color:#000000 !important; color:#000000; font-weight:normal; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-size:12px !important; line-height:18px !important; line-height:18px; margin-top:2px !important;">
This message came from outside your organization.
</div>
</div>
<div id="pfptBannerrftpadh" style="all: unset !important; float: right !important; display: block !important; display: block; margin: 0px 0px 0px 16px !important; text-align: right !important; width: fit-content !important;">
<a id="pfptBannerrftpadh" href="https://us-phishalarm-ewt.proofpoint.com/EWT/v1/KGKeukY!vYQd06jLTGauQXIZtEFNe8JMImpKSxxkSqDPe1PW8zOxJQCCXShEwIGBZ93sMXoSAdNeJmHgoHrSgsiB6qOw2KJJzfqxF2cw8gIASww2b0NnuJk3iibz2-yWFi96GlJfHNj1zA$"
style="all: unset !important; display: inline-block !important; text-decoration: none">
<div class="pfptPrimaryButtonrftpadh" style="display: inline-block !important; display: inline-block; visibility: visible !important; opacity: 1 !important; color: #000000 !important; color: #000000; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-size: 14px !important; font-weight: normal !important; text-decoration: none !important; border-radius: 2px !important; padding: 7.5px 16px !important; margin: 3px 0 3px 16px !important; white-space: nowrap !important; width: fit-content !important;
border: 1px solid #666666">
Report Suspicious
</div>
</a>
</div>
<div style="clear: both !important; display: block !important; visibility: hidden !important; line-height: 0 !important; font-size: 0.01px !important; height: 0px"> </div>
</div>
<![endif]>
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">ZjQcmQRYFpfptBannerEnd</div>
<!-- Email Banner : END -->
<!-- BaNnErBlUrFlE-BoDy-end -->
<div dir="ltr"><div dir="ltr"><div>Hello Nat,</div><div><br></div>Awesome, thanks for the info! I will retry and let you know later. Also, to do the ./configure --with-device=ch3:nemesis have no problem, but when we do afterward will have two error: 1st:when it goes to /src/mpid/ch3/channels/nemesis/netmod/tcp/tcp_init.c , 391 we need change mpierrno to mpi_error otherwise can't declared. 2nd, in /src/mpid/ch3/channels/nemesis/netmod/tcp/tcp_getip.c 155, we have to change the addr struct to fit the in_addr. Let you know.</div><div dir="ltr"><br></div><div>Also,I am work with Dr.Tomov with cluster test and performance, might need more support later, thanks!</div><div><br></div><div>sincerely,</div><div>Ryan Lei</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Jun 23, 2023 at 9:48 AM Shineman, Nat <<a href="mailto:shineman.5@osu.edu">shineman.5@osu.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="msg-5613395445929211328">
<div dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Hi Ryan, <br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Based on the description of your setup you need to build with the <code>ch3:sock</code> device, or
<code>ch3:nemesis:tcp</code> device. The default device for MVAPICH2 2.3.7 is <code>
ch3:mrail</code>. This device is suited for high performance IB networks. Since you are using a standard ethernet network, it will not work for your system. Please note that the MVAPICH team does not actively support standard ethernet networks, as our focus
is on high performance networks, so most of the designs in the <code>ch3:sock</code> and
<code>ch3:nemesis:tcp</code> devices will be those found in stock MPICH. You can build for these devices by running
<code>./configure --device=ch3:nemesis. <span style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
For more information, </span></code> please see section 4.11 of our user guide: <a href="https://mvapich.cse.ohio-state.edu/static/media/mvapich/mvapich2-userguide.html" id="m_-5613395445929211328LPlnk513332" target="_blank">
https://mvapich.cse.ohio-state.edu/static/media/mvapich/mvapich2-userguide.html</a>.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Thanks,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Nat<br>
</div>
<div id="m_-5613395445929211328appendonsend"></div>
<hr style="display:inline-block;width:98%">
<div id="m_-5613395445929211328divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Mvapich-discuss <<a href="mailto:mvapich-discuss-bounces@lists.osu.edu" target="_blank">mvapich-discuss-bounces@lists.osu.edu</a>> on behalf of Lei, Ryan via Mvapich-discuss <<a href="mailto:mvapich-discuss@lists.osu.edu" target="_blank">mvapich-discuss@lists.osu.edu</a>><br>
<b>Sent:</b> Thursday, June 22, 2023 15:41<br>
<b>To:</b> <a href="mailto:mvapich-discuss@lists.osu.edu" target="_blank">mvapich-discuss@lists.osu.edu</a> <<a href="mailto:mvapich-discuss@lists.osu.edu" target="_blank">mvapich-discuss@lists.osu.edu</a>><br>
<b>Subject:</b> [Mvapich-discuss] MPI Running Problem.</font>
<div> </div>
</div>
<div>
<div style="font-size:1px;color:rgb(255,255,255);line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;display:none">
Hello Sir/Madam, Nice to meet you guys. I am currently building a cluster with 2 slave nodes of jetson nano and 1 master node of jetson orin connected with ethernet. I have verified the passwordless ssh and all the connections, all the devices
</div>
<div style="font-size:1px;color:rgb(255,255,255);line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;display:none">
</div>
<div dir="ltr">Hello Sir/Madam,
<div><br>
</div>
<div>Nice to meet you guys. I am currently building a cluster with 2 slave nodes of jetson nano and 1 master node of jetson orin connected with ethernet. I have verified the passwordless ssh and all the connections, all the devices ip have been set properly.
The version of mvapich2 is 2.3.7. When I run "mpirun -np 3 -hostfile hostfile ./hello", I will face an error with no HCAs found and lead to an aborting job. Even if I set -iface to pick a specific interface eth0, it still just out this problem. I have tried
"MV2_IBA_HCA=eth0 MV2_DEFAULT_PORT=0" and some other way to jump out the HCAs and IB, but non of them are working, do you have some idea about how to solve this problem?</div>
<div><img alt="1.jpg" width="462" height="260" src="cid:188e943b5e42c904a41"><br>
</div>
<div><br>
</div>
<div>Also, if I try to do "mpirun -np 2 -hosts 192.168.2.10,192.168.2.11(ip for two node) /home/reu/hello" , I will also face some problem and ask me to check the firewall, which is different port each time, I am also need some help with it.</div>
<div><img alt="2.jpg" width="462" height="260" src="cid:188e943b5e42d71c252"><br>
</div>
<div><br>
</div>
<div>Last, I can do rsh <a href="mailto:reu@192.168.2.10" target="_blank">reu@192.168.2.10</a> (or 11) mpirun -n 2 ./hello easily, but when I do rsh
<a href="mailto:reu@192.168.2.10" target="_blank">reu@192.168.2.10</a>,<a href="mailto:reu@192.168.2.11" target="_blank">reu@192.168.2.11</a> mpirun ... at one command, it will ask me for password for some reason, what's the problem there?</div>
<div><br>
</div>
<div>Thanks for your time.</div>
<div><br>
</div>
<div>sincerely,</div>
<div>Ryan Lei</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div> </div>
</div>
</div>
</div>
</div></blockquote></div>