[mvapich-discuss] mpirun runtime problems with ch_gen2

[Sayantan Sur]

Hello Guido,

Thanks for giving our SVN revision a whirl! We're sorry you faced this
issue. Gen2 (ch_gen2) is indeed supported for MVAPICH-0.9.7. In order to
compile/use MVAPICH-0.9.7 over Gen2, please refer to our user guide:

http://nowlab.cse.ohio-state.edu/projects/mpi-iba/mvapich_user_guide.html

Sections 4.4.1 and 5.2 give detailed instructions on building and
running MPI programs over Gen2. These include compile instructions and
running instructions using `mpirun_rsh'. Normally, mpirun too should
work for running programs over Gen2. We will investigate this issue and
get back to you. However, in the meantime, please continue to use
`mpirun_rsh' or `mpirun_mpd' based startup for running MPI jobs over
OpenIB/Gen2.

Thanks,
Sayantan.

* On Apr,1 Guido Passet<guido.passet at clustervision.com> wrote :
> Hi All,
> 
> I seem to be getting some strange error with mpirun in combination with 
> the ch_gen2 device. I am using the OSU MVAPICH 0.9.7 (03/14/06) 
> (Integrated MVAPICH tarball with MPICH 1.2.7 + MVICH) Altho i get the 
> exact same thing with the latest SVN checkout.
> 
> Please see the paste below describing the problem i run into:
> 
> $> mpirun -nolocal -machinefile nodes -np 2 ./foo
> 
> Cannot find MPIRUN machine file for machine ch_gen2
> and architecture LINUX.
> (No device specified.)
> 
> I more or less compile mvapich as stated below:
> 
> export CC="gcc"
> export FC="g77"
> export CXX="g++"
> export C_COMPILER="$CC"
> export FORTRAN_COMPILER="$FC"
> export OPTFLAGS="-O3 -g -fno-strict-aliasing"
> export RSHCOMMAND="ssh"
> export CFLAGS="-D_X86_64_ \
>                -DEARLY_SEND_COMPLETION \
>                -DMEMORY_SCALE \
>                -DVIADEV_RPUT_SUPPORT \
>                -DLAZY_MEM_UNREGISTER \
>                -DCH_GEN2 \
>                -D_SMP_ \
>                -D_SMP_RNDV_ \
>                -D_DDR_ \
>                -D_PCI_EX_ \
>                -I%{openibhome0}/include"
> export FFLAGS="-L%{openibhome0}/lib"
> ./configure \
>       --with-arch=LINUX \
>       --with-device=ch_gen2 \
>       --with-romio \
>       --without-mpe \
>       --enable-f90 \
>        -c++=$CXX \
>        -lib="-L%{openibhome0}/lib -libverbs -lpthread" \
>        -opt="$OPTFLAGS" \
>        -prefix=%{destdir0}/%{name}/%{version}
> 
> which seems to compile fine. However when i want to use mpirun it fails 
> because of the ch_gen2 device.
> 
> Am i missing something here or is ch_gen2 not fully supported yet? The 
> MVAPICH 0.9.7 release notes state gen2 support. However ./configure 
> --help does not list the device. BUT it is found in several places.
> 
> Running things through the interactive make.mvapich.gen2 script does the 
> exact same thing.
> 
> Compiling things with --with-device=ch_p4 gets me rid of my mpirun 
> problem but runs over tcpip :(
> 
> Any advise or clues would be very appreciated!
> 
> 
> With kind regards,
> -- 
> Guido Passet            Email: guido.passet at clustervision.com
> 
> ClusterVision BV        Email support: support at clustervision.com
> Nieuw-Zeelandweg 15B    Web: http://www.clustervision.com
> 1045 AL Amsterdam       Tel: +31 20 407 7550
> The Netherlands         Fax: +31 84 759 8389
> _______________________________________________
> mvapich-discuss mailing list
> mvapich-discuss at cse.ohio-state.edu
> http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss

-- 
http://www.cse.ohio-state.edu/~surs