[mvapich-discuss] MVAPICH on Solaris

[LEI CHAI]

Hi Hossein,

Thank you for trying out MVAPICH2. There are several
possible reasons why you see the "Cannot open IA" 
error:

* Please check the /etc/dat/dat.conf file, there
should be a line like:

 ibd2  u1.2  nonthreadsafe  default  udapl_tavor.so.1  SUNW.1.0  " "  "driver_name=tavor"

* Please make sure ip over ib is setup correctly, 
i.e. you should be able to ping the machine's 
ipoib address. You mentioned that the 
infiniband(ibd2) is with *invalid* address, which
should be fixed.

* MVAPICH2 on Solaris uses "ibd0" as the default 
interface. If you didn't change it to ibd2 when you
build mvapich2, you need to set the environment 
variable correctly when you run the program, e.g.

mpiexec -n 1 -env DAPL_PROVIDER ibd2 ./cpi

And we suggest that you use mpiexec instead of
mpirun, the usage of mpiexec can be found in 
mvapich2 user guide, section 5.2:

http://mvapich.cse.ohio-state.edu/support/user_guide_mvapich2.html#x1-170005.2

Regards,
Lei


----- Original Message -----
From: Hossein Pourreza <pourreza at cs.umanitoba.ca>
Date: Friday, May 11, 2007 12:49 pm
Subject: [mvapich-discuss] MVAPICH on Solaris

> Hi,
> 
> Recently I have a chance to use a Solaris cluster connected using 
> infinibandinterface (Sun X4200 machines, Dual Opteron, Solaris 10). 
> I could run MVAPICh
> configured with tcp without any problem but I am getting only 
> (180MBytes/sec)bandwidth which I believe is very low. So I 
> installed 
> MVAPICH2-0.9.8p2 using udapl configuration. Everything
> was fine and compilation finished without any problem. When I want 
> to run an
> application using mpirun, I am getting the following error:
> 
> I tried: mpirun -np 1 ./cpi (mpirun comes from the installation 
> directory)
> [rdma_udapl_priv.c:648] error(-2146828288): Cannot open IA
> 
> I ran mpd first and then tried mpirun. The nodes have two 
> interfaces, gigabit
> Ethernet with valid IP address and infiniband (ibd2) with invalid 
> IP address.
> 
> Here is the result of running prtconf
> ib, instance #0
> rpcib, instance #0
> daplt, instance #0
> 
> Might be of your interest, the result of running 
> make.mvapich2.detect is like:
> 
> No HCAs autodetected
> 
> Pick one of the following options to optimize MVAPICH for:
> 
> 1) Mellanox PCI-Express (SDR)
> 2) Mellanox PCI-Express (DDR)
> 3) Mellanox PCI-X
> 4) Pathscale HT
> 5) IBM ehca
> 
> ==> 3
> Using _MLX_PCI_X_
> 
> 
> I do not have any experience of working with infiniband and I am 
> new to Sun too.
> I used to work with Linux for many years.
> 
> Do you have any idea what the possible problem might be?
> 
> Many thanks
> Hossein
> 
> -- 
> Hossein Pourreza                                 
> 	mail:<pourreza at cs.umanitoba.ca>    
> Department of Computer Science        	URL: 
> http://www.cs.umanitoba.ca/~pourrezaUniversity of Manitoba          
>        	Phone: 204-488-5611            
> Winnipeg, Manitoba, Canada R3T 2N2
> 
> _______________________________________________
> mvapich-discuss mailing list
> mvapich-discuss at cse.ohio-state.edu
> http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
>