<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"Arial Black";
panose-1:2 11 10 4 2 1 2 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link="#0563C1" vlink="#954F72"><div class=WordSection1><p class=MsoNormal>Does MVPAICH2 have support for running in VMs with VMXNET3 or the PVRDMA network adapter that supports RoCE v1/v2?<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Currently with the default build parameters and native rdma-core libraries on RHEL 8.5, I am seeing this message about unknown HCA on both VMXNET3 and PVRDMA:<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>[rdma_open_hca] Unknown HCA type: this build of MVAPICH2 does notfully support the HCA found on the system (try with other build options)<o:p></o:p></p><p class=MsoNormal>[cli_1]: aborting job:<o:p></o:p></p><p class=MsoNormal>Fatal error in MPI_Init:<o:p></o:p></p><p class=MsoNormal>Other MPI error, error stack:<o:p></o:p></p><p class=MsoNormal>MPIR_Init_thread(493)............:<o:p></o:p></p><p class=MsoNormal>MPID_Init(419)...................: channel initialization failed<o:p></o:p></p><p class=MsoNormal>MPIDI_CH3_Init(470)..............: rdma_get_control_parameters<o:p></o:p></p><p class=MsoNormal>rdma_get_control_parameters(1925): rdma_open_hca<o:p></o:p></p><p class=MsoNormal>rdma_open_hca(1080)..............: Failed to open HCA: No such file or directory<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Sincerely,<o:p></o:p></p><p class=MsoNormal><i><span style='font-size:12.0pt;font-family:"Arial",sans-serif;color:gray'><img width=82 height=32 style='width:.8541in;height:.3333in' id="Picture_x0020_1" src="cid:image001.jpg@01D7E60A.30C50A40" alt="Description: LL"></span></i><span style='font-size:12.0pt;font-family:"Times New Roman",serif;color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><i><span style='font-size:12.0pt;font-family:"Arial Black",sans-serif;color:gray'>Nicholas Clark</span></i><span style='font-size:12.0pt;font-family:"Times New Roman",serif;color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:8.0pt;font-family:"Arial",sans-serif;color:gray'>MIT Lincoln Laboratory <o:p></o:p></span></p><p class=MsoNormal><span style='font-size:8.0pt;font-family:"Arial",sans-serif;color:gray'>ISR and Tactical Systems Division<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:8.0pt;font-family:"Arial",sans-serif;color:gray'>Embedded and Open Systems Group<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:8.0pt;font-family:"Arial",sans-serif;color:gray'>Systems Administration</span><span style='font-size:8.0pt;font-family:"Times New Roman",serif;color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:8.0pt;font-family:"Arial",sans-serif;color:gray'>244 Wood St., S3-487</span><i><span style='font-family:"Arial",sans-serif;color:#1F497D'><o:p></o:p></span></i></p><p class=MsoNormal><span style='font-size:8.0pt;font-family:"Arial",sans-serif;color:gray'>Lexington, MA 02421-6426</span><span style='font-size:8.0pt;font-family:"Times New Roman",serif;color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:8.0pt;font-family:"Arial",sans-serif;color:gray'>(O): 781-981-9342</span><span style='font-size:8.0pt;font-family:"Times New Roman",serif;color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:8.0pt;font-family:"Arial",sans-serif;color:#1F497D'><a href="mailto:nicholas.clark@ll.mit.edu"><span style='color:blue'>nicholas.clark@ll.mit.edu</span></a></span><span style='font-size:8.0pt;font-family:"Times New Roman",serif;color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p></div></body></html>