[mvapich-discuss] No IB device found

[Christopher Tanner]

All -

I have installed OFED and mvapich2 on the master and all 16 nodes. I  
have rebooted the master, followed by rebooting all of the nodes.  
After starting up a mpd ring, I try to execute the OSU benchmarks to  
receive:

libibverbs: Fatal: couldn't read uverbs ABI version.
Fatal error in MPI_Init:
Other MPI error, error stack:
MPIR_Init_thread(259)...........: Initialization failed
MPID_Init(102)..................: channel initialization failed
MPIDI_CH3_Init(178).............:
MPIDI_CH3I_RMDA_init(115).......: rdma_get_control_parameters
rdma_get_control_parameters(432):
rdma_open_hca(367)..............: No IB device found
rank 3 in job 1  master.cl.ae.gatech.edu_41302   caused collective  
abort of all ranks
   exit status of rank 3: return code 1

I've posted this error before, however I simply received the solution  
to "make sure you are loading your Infiniband kernel modules" or  
something similar. Aside from performing the install and rebooting the  
machines - how do I initialize the Infiniband stuff? I'm new to Linux  
so I'm pretty clueless as to the commands / procedures to do this...

Thanks for your help guys.

-------------------------------------------
Chris Tanner
Space Systems Design Lab
Georgia Institute of Technology
christopher.tanner at gatech.edu
-------------------------------------------