<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
Hi Ryan, <br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0">
Based on the description of your setup you need to build with the <code>ch3:sock</code> device, or
<code>ch3:nemesis:tcp</code> device. The default device for MVAPICH2 2.3.7 is <code>
ch3:mrail</code>. This device is suited for high performance IB networks. Since you are using a standard ethernet network, it will not work for your system. Please note that the MVAPICH team does not actively support standard ethernet networks, as our focus
is on high performance networks, so most of the designs in the <code>ch3:sock</code> and
<code>ch3:nemesis:tcp</code> devices will be those found in stock MPICH. You can build for these devices by running
<code>./configure --device=ch3:nemesis. <span style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
For more information, </span></code> please see section 4.11 of our user guide: <a href="https://mvapich.cse.ohio-state.edu/static/media/mvapich/mvapich2-userguide.html" id="LPlnk513332">
https://mvapich.cse.ohio-state.edu/static/media/mvapich/mvapich2-userguide.html</a>.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0">
Thanks,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0">
Nat<br>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Mvapich-discuss <mvapich-discuss-bounces@lists.osu.edu> on behalf of Lei, Ryan via Mvapich-discuss <mvapich-discuss@lists.osu.edu><br>
<b>Sent:</b> Thursday, June 22, 2023 15:41<br>
<b>To:</b> mvapich-discuss@lists.osu.edu <mvapich-discuss@lists.osu.edu><br>
<b>Subject:</b> [Mvapich-discuss] MPI Running Problem.</font>
<div> </div>
</div>
<style>
<!--
#x_pfptBannerbuu4oc3
{display:block!important;
visibility:visible!important;
opacity:1!important;
background-color:#CFD3D7!important;
max-width:none!important;
max-height:none!important}
-->
</style>
<div>
<div style="display:none!important; display:none; visibility:hidden; font-size:1px; color:#ffffff; line-height:1px; height:0px; max-height:0px; opacity:0; overflow:hidden">
Hello Sir/Madam, Nice to meet you guys. I am currently building a cluster with 2 slave nodes of jetson nano and 1 master node of jetson orin connected with ethernet. I have verified the passwordless ssh and all the connections, all the devices
</div>
<div style="display:none!important; display:none; visibility:hidden; font-size:1px; color:#ffffff; line-height:1px; height:0px; max-height:0px; opacity:0; overflow:hidden">
ZjQcmQRYFpfptBannerStart</div>
<div dir="ltr" lang="en" id="x_pfptBannerbuu4oc3" style="display:block!important; text-align:left!important; margin:16px 0px 16px 0px!important; padding:8px 16px 8px 16px!important; border-radius:4px!important; min-width:200px!important; background-color:#CFD3D7!important; background-color:#CFD3D7; border-top:4px solid #8c8e91!important; border-top:4px solid #8c8e91">
<div id="x_pfptBannerbuu4oc3" style="float:left!important; display:block!important; margin:0px 0px 1px 0px!important; max-width:600px!important">
<div id="x_pfptBannerbuu4oc3" style="display:block!important; visibility:visible!important; background-color:#CFD3D7!important; color:#000000!important; color:#000000; font-family:'Arial',sans-serif!important; font-family:'Arial',sans-serif; font-weight:bold!important; font-weight:bold; font-size:14px!important; line-height:18px!important; line-height:18px">
This Message Is From an External Sender </div>
<div id="x_pfptBannerbuu4oc3" style="display:block!important; visibility:visible!important; background-color:#CFD3D7!important; color:#000000!important; color:#000000; font-weight:normal; font-family:'Arial',sans-serif!important; font-family:'Arial',sans-serif; font-size:12px!important; line-height:18px!important; line-height:18px; margin-top:2px!important">
This message came from outside your organization. </div>
</div>
<div id="x_pfptBannerbuu4oc3" style="float:right!important; display:block!important; display:block; margin:0px 0px 0px 16px!important; text-align:right!important; width:fit-content!important">
<a id="x_pfptBannerbuu4oc3" href="https://us-phishalarm-ewt.proofpoint.com/EWT/v1/KGKeukY!vYQd06jLTGauQXKQMMLL1yWuR-bceqPKHqTRduO9GSP06swa8enCqPeBug2UoURXdQL7Dyj--RHVMKdu_JtZ6A-lLDnLAb8rDz6tW0gMLXADa3ufcdiSe9z38UBpZc7tdBl5yg$" style="display:inline-block!important; text-decoration:none">
<div class="x_pfptPrimaryButtonbuu4oc3" style="display:inline-block!important; display:inline-block; visibility:visible!important; opacity:1!important; color:#000000!important; color:#000000; font-family:'Arial',sans-serif!important; font-family:'Arial',sans-serif; font-size:14px!important; font-weight:normal!important; text-decoration:none!important; border-radius:2px!important; padding:7.5px 16px!important; margin:3px 0 3px 16px!important; white-space:nowrap!important; width:fit-content!important; border:1px solid #666666">
Report Suspicious </div>
</a></div>
<div style="clear:both!important; display:block!important; visibility:hidden!important; line-height:0!important; font-size:0.01px!important; height:0px">
</div>
</div>
<div style="display:none!important; display:none; visibility:hidden; font-size:1px; color:#ffffff; line-height:1px; height:0px; max-height:0px; opacity:0; overflow:hidden">
ZjQcmQRYFpfptBannerEnd</div>
<div dir="ltr">Hello Sir/Madam,
<div><br>
</div>
<div>Nice to meet you guys. I am currently building a cluster with 2 slave nodes of jetson nano and 1 master node of jetson orin connected with ethernet. I have verified the passwordless ssh and all the connections, all the devices ip have been set properly.
The version of mvapich2 is 2.3.7. When I run "mpirun -np 3 -hostfile hostfile ./hello", I will face an error with no HCAs found and lead to an aborting job. Even if I set -iface to pick a specific interface eth0, it still just out this problem. I have tried
"MV2_IBA_HCA=eth0 MV2_DEFAULT_PORT=0" and some other way to jump out the HCAs and IB, but non of them are working, do you have some idea about how to solve this problem?</div>
<div><img alt="1.jpg" width="462" height="260" data-outlook-trace="F:1|T:1" src="cid:ii_lj7jqwq01"><br>
</div>
<div><br>
</div>
<div>Also, if I try to do "mpirun -np 2 -hosts 192.168.2.10,192.168.2.11(ip for two node) /home/reu/hello" , I will also face some problem and ask me to check the firewall, which is different port each time, I am also need some help with it.</div>
<div><img alt="2.jpg" width="462" height="260" data-outlook-trace="F:1|T:1" src="cid:ii_lj7jr6ff2"><br>
</div>
<div><br>
</div>
<div>Last, I can do rsh <a href="mailto:reu@192.168.2.10">reu@192.168.2.10</a> (or 11) mpirun -n 2 ./hello easily, but when I do rsh
<a href="mailto:reu@192.168.2.10">reu@192.168.2.10</a>,<a href="mailto:reu@192.168.2.11">reu@192.168.2.11</a> mpirun ... at one command, it will ask me for password for some reason, what's the problem there?</div>
<div><br>
</div>
<div>Thanks for your time.</div>
<div><br>
</div>
<div>sincerely,</div>
<div>Ryan Lei</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div> </div>
</div>
</div>
</body>
</html>