[mvapich-discuss] Has anyone enabled InfiniBand in IBM BladeCenter JS21 by OFED 1.2.5

[Matthew Koop]

Hi,

In regards to your first comment:

"I want to install OFED 1.2.5 on the IBM BladeCenter to use the MvapiCH2
shipped with it, but unfortunately it seems that the MPI uses the Ethernet
to communicate as before, "

If you are using the MVAPICH2 from OFED it should use InfiniBand (or
iWARP). Only the initial control messages to launch processes use normal
TCP. Why does it seem like it it using Ethernet?

"mpdboot_node01 (handle_mpd_output 359): failed to ping mpd on node01;
recvd output={}"

This is likely a setup issue not related to InfiniBand. Can you try using
the MPICH2 installers guide for using mpdboot (it has special
troubleshooting instructions to guide you at the end of the document)?

http://www.mcs.anl.gov/research/projects/mpich2/documentation/files/mpich2-doc-install.pdf

You will likely want to try starting the mpd daemons by hand rather than
through mpdboot to figure out setup issues since it will give you more
output.

Thanks and let us know if you continue to have problems.

Matt




On Mon, 17 Dec 2007, jetspeed wrote:

> same as http://lists.freebsd.org/pipermail/freebsd-cluster/2007-June/000351.html
>
>
> On Mon, 17 Dec 2007 17:06:15 +0800
> jetspeed <ibatis2 at 163.com> wrote:
>
> > Thanks, maybe my OFED is installed successfully,  I will check this later.
> >
> > the problem is ,  after I select the mpi version
> >
> > Current system default: mvapich2_gcc-0.9.8
> > Current user default:   mvapich2_gcc-0.9.8
> >
> > then  , I use mpdboot, and got
> >
> > "mpdboot_node01 (handle_mpd_output 359): failed to ping mpd on node01; recvd output={}"
> >
> > maybe other settings needed for Mvapich?
> >
> > On Fri, 14 Dec 2007 10:18:09 -0500
> > Jeff Squyres <jsquyres at cisco.com> wrote:
> >
> > > On Dec 14, 2007, at 10:04 AM, Dhabaleswar Panda wrote:
> > >
> > > >>     I remember OFED ships with OpenMPI not mvapich2?
> > > >
> > > > OFED includes MVAPICH, MVAPICH2 and OpenMPI. During the
> > > > installation, one
> > > > can select which MPI version to be installed through the `mpi
> > > > selector'
> > > > function.
> > >
> > > FWIW, you can run the mpi-selector-menu program at any time -- not
> > > just during the OFED installation.  mpi-selector-menu allows you to
> > > choose which MPI you want to use, either at a system-wide basis or on
> > > a per-user basis.  See mpi-selector-menu(1) for more details, or mpi-
> > > selector(1) for even more details.
> > >
> > > (mpi-selector-menu is a simple menu-based wrapper around the back-end
> > > mpi-selector command)
> > >
> > > --
> > > Jeff Squyres
> > > Cisco Systems
> > > _______________________________________________
> > > mvapich-discuss mailing list
> > > mvapich-discuss at cse.ohio-state.edu
> > > http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
> >
> >
> >
> > _______________________________________________
> > mvapich-discuss mailing list
> > mvapich-discuss at cse.ohio-state.edu
> > http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
>
>
>
> _______________________________________________
> mvapich-discuss mailing list
> mvapich-discuss at cse.ohio-state.edu
> http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
>