[mvapich-discuss] Cannot run test mpirun after install mvapich.

[phan nguyen]

Hi Mat,
Now that I tried on both version OSU MVAPICH 0.9.9 + InfiniPath  or OSU
MVAPICH 0.9.9 and have it installed under different $PREFIX

OSU MVAPICH 0.9.9 + InfiniPath  -- > /ixdata/IX_Sodtware/mvapich
And OSU MVAPICH 0.9.9 --> /ixdata/IX_Sodtware/mvapich1

I compiled the programs as root and run the test as root
mpirun_rsh -np 2 htcixcluster htcixcluster ./bw
It seems to run after prompting the passwords 
But when I run the same program with my regular id, it did not return any
message.
Note that root default shell is bash and it has ssh authentication setup to
all the compute nodes, and my id's default shell is tcsh. My id has rsh
authentication setup

Definitely, when running with my id, the installed mpirun did not work for
some reason..

To simplify the matter, Let's focus on one version only - (version
mvapich-0.9.9+psm as stated in the previous email) 


Phan Nguyen
Work:   713 513 2550
Mobile: 281 650 8280

-----Original Message-----
From: Matthew Koop [mailto:koop at cse.ohio-state.edu] 
Sent: Tuesday, July 03, 2007 2:44 PM
To: phan nguyen
Cc: mvapich-discuss at cse.ohio-state.edu
Subject: RE: [mvapich-discuss] Cannot run test mpirun after install mvapich.


> Which version do you recommend?
> OSU MVAPICH 0.9.9 + InfiniPath  or OSU MVAPICH 0.9.9
> I still have trouble installing with my IB path?

Either of them will work for you. "OSU MVAPICH 0.9.9 + InfiniPath" is the
MVAPICH 0.9.9 release along with a new ch_psm device specifically for the
InfiniPath HCAs from QLogic/PathScale.

So, you are now compiling with $PREFIX/bin/mpicc and running with
$PREFIX/bin/mpirun_rsh?

Can you try something like:

cd $SRC/osu_benchmarks
$PREFIX/bin/mpicc osu_bw.c -o bw
$PREFIX/bin/mpirun_rsh -np 2 host1 host2 ./bw
(where host1 and host2 are machines you want to run on)

In order to run with this setup you will need to be able to ssh from the
launching node to the compute nodes without a password. So, make sure you
have password-less keys setup for ssh before you try this out. So 'ssh
host1' should not prompt for a password.

Let us know what happens if you follow the above steps.

Thanks,

Matt






> -----Original Message-----
> From: Matthew Koop [mailto:koop at cse.ohio-state.edu]
> Sent: Wednesday, June 27, 2007 8:54 PM
> To: phan nguyen
> Cc: mvapich-discuss at cse.ohio-state.edu
> Subject: Re: [mvapich-discuss] Cannot run test mpirun after install
mvapich.
>
> Phan,
>
> Just to get some details here -- I have a few questions that will help us
> diagnose the issue here:
>
> - Do you have VAPI installed? (e.g. Topspin or IB-Gold)
> - Does compilation finish successfully?
> - What OS/platform is this being installed on?
> - How are you compiling? Is it with the mpicc in $PREFIX/bin?
>
> Also, if you want to run a serial MPI job, you must still use the
> mpirun_rsh command to launch it. Just run it with only one process.
>
> Matt
>
>
>
> On Wed, 27 Jun 2007, phan nguyen wrote:
>
> > Hi,
> >
> > I tried to install mvapich on my cluster (version mvapich-0.9.9+psm)
> >
> > For installation, I use the custom make file  make.mvapich.vapi where I
> > change only the $PREFIX to point to MPI the location on my machine.
> >
> >
> >
> > # Mandatory variables.  All are checked except CXX and F90.
> >
> > MTHOME=/usr/local/ibgd/driver/infinihost
> >
> > #PREFIX=/usr/local/mvapich
> >
> > PREFIX=/ixdata/IX_Software/mvapich
> >
> >
> >
> > This IB path remained intact.
> >
> >
> >
> > After the install, I cannot run any test program under /examples (after
> > compiling)
> >
> > When building with my application and run some serial test (without
> mpirun)
> > I got this error
> >
> > error while loading shared libraries: libpmpich++.so.1.0: cannot open
> shared
> > object file: No such file or directory
> >
> >
> >
> > I am sure this lib is in my LD_LIBRARY_PATH.
> >
> > Please help since this is my first time install MPICH over Infiniband,
> >
> > Regards,
> >
> >
> >
> > Phan Nguyen
> >
> > Work:   713 513 2550
> >
> > Mobile: 281 650 8280
> >
> >
> >
> >
>