[mvapich-discuss] mvapich-0.9.6-121 problems

[Michael Li]

Hi,
I am new to mvapich.
I've downloaded mvapich-0.9.6-121 and built
mvapich-0.9.6-121 with PCI-Express and SDR settings
based on the spec from our hardware vendor Microway.

I made some changes on make.mvapich.vapi and
used it to build  mvapich-0.9.6-121, please see
attached make.mvapich.vapi.

The driver is
Mellanox IB Gold Distribution (IBGD) v1.7.0 for Linux
which comes with the box.

The OS info is :
% uname -a
Linux sftc001 2.6.10-suse92-i4smp #62 SMP Thu Mar 31 12:03:47 EST 2005 
i686 i686
  i386 GNU/Linux

% cat /etc/issue

Welcome to SuSE Linux 9.2 (i586) - Kernel \r (\l).


I ran my applications, I got problems as follows:

(1)
  $DEFORM3_DIR/mvapich/bin/mpirun -np 2 -hostfile 
$DEFORM3_DIR/mvapich/share/mach
ines/hosts.list $DEFORM3_DIR/EXE/DEF_SIM_P4P_INFINIBAND.EXE

[0] Abort: Null value returned by gethostbyname at line 1549 in file 
viainit.c
mpirun: executable version 0 does not match our version 3.


(2)
  $DEFORM3_DIR/mvapich/bin/mpirun -np 5 -hostfile 
$DEFORM3_DIR/mvapich/share/machines/hosts.list 
$DEFORM3_DIR/EXE/DEF_SIM_P4P_INFINIBAND.EXE

gethostbyname: No address associated with name



done.


(3)
$DEFORM3_DIR/mvapich/bin/mpirun -np 6 -hostfile 
$DEFORM3_DIR/mvapich/share/machines/hosts.list 
$DEFORM3_DIR/EXE/DEF_SIM_P4P_INFINIBAND.EXE

Permission denied.

Either cases I tried again, it ran through.

Can any one point me a direction where is the problems
and how to fix it?

I knew that IBGD-1.8.1 is available, but I am not sure
I should update to it.


Best regards.
Michael Li



-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-
This email message and any attachments are for the sole use of the
intended recipients and may contain proprietary and/or confidential 
information which may be privileged or otherwise protected from 
disclosure. Any unauthorized review, use, disclosure or distribution is 
prohibited. If you are not the intended recipients, please contact the 
sender by reply email and destroy the original message and any copies of 
the message as well as any attachments to the original message.
-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-
-------------- next part --------------
#!/bin/bash

source ./make.mvapich.def
arch

# Mandatory variables.  All are checked except CXX and F90.
MTHOME=/usr/local/ibgd/driver/infinihost
# org PREFIX=/tmp/mvapich
PREFIX=/home/deform/infiniband/mvapich_dest
export CC=gcc
export CXX=g++
export F77=f90
export F90=f90
# export FFLAGS="-YEXT_SFX=_ -YEXT_NAMES=LCS -L/ibgd/driver/infinihost/lib -I/ibgd/driver/infinihost/include -O2"
# export F90FLAGS=$FFLAGS


if [ $ARCH = "SOLARIS" ]; then
    die_setup "MVAPICH VAPI is not supported on Solaris."
elif [ $ARCH = "MAC_OSX" ]; then
    MTHOME=/usr/SmallTree
    export PATH=$PATH:/opt/ibmcmp/xlf/8.1/bin
    export FC=xlf
    export F90=xlf90
    export MAC_OSX=yes
    SUPPRESS="-multiply_defined suppress"
fi

# Check mandatory variable settings.
if [ -z $MTHOME ] || [ -z $PREFIX ] || [ -z $CC ] || [ -z $F77 ]; then
    die_setup "Please set mandatory variables in this script."
elif [ ! -d $MTHOME ]; then
    die_setup "MTHOME directory $MTHOME does not exist."
elif [ $ARCH = "_EM64T_" ] || [ $ARCH = "_X86_64_" ]; then
    if [ -d $MTHOME/lib64 ]; then
	MTHOME_LIB=$MTHOME/lib64
    elif [ -d $MTHOME/lib ]; then
	MTHOME_LIB=$MTHOME/lib
    else
	die_setup "Could not find the MTHOME/lib64 or MTHOME/lib directory."
    fi
elif [ -d $MTHOME/lib ]; then
    MTHOME_LIB=$MTHOME/lib
else
    die_setup "Could not find the MTHOME/lib directory."
fi

# Optional variables.  Most of these are prompted for if not set.
#

# I/O Bus type.
# Supported: "_PCI_X_" and "_PCI_EX_"
# org IO_BUS=
IO_BUS=_PCI_EX_

if [ -z "$IO_BUS" ]; then
    prompt_io_bus
fi

# Link speed rate.
# Supported: "_DDR_" and "_SDR_" (PCI-Express)
#            "_SDR_" (PCI-X)
# org LINKS=
LINKS=_SDR_

if [ -z "$LINKS" ]; then
    prompt_link
fi

# Whether to use an optimized queue pair exchange scheme.  This is not
# checked for a setting in in the script.  It must be set here explicitly.
# Supported: "-DUSE_MPD_RING", "-DUSE_MPD_BASIC" and "" (to disable)
HAVE_MPD_RING=""

# Set this to override automatic optimization setting (-03).
OPT_FLAG=

if [ -z $OPT_FLAG ]; then
    OPT_FLAG=-O3
fi

export LIBS="-L${MTHOME_LIB} -lmtl_common -lvapi -lpthread -lmosal -lmpga $SUPPRESS"
# org export FFLAGS="-L${MTHOME_LIB}"
export FFLAGS="-YEXT_SFX=_ -YEXT_NAMES=LCS -L/ibgd/driver/infinihost/lib -I/ibgd/driver/infinihost/include -O2"
export F90FLAGS=$FFLAGS
export CFLAGS="-D${ARCH} -DUSE_INLINE -DEARLY_SEND_COMPLETION -DRDMA_FAST_PATH \
               -DVIADEV_RPUT_SUPPORT -DLAZY_MEM_UNREGISTER -D_SMP_ -D_SMP_RNDV_ \
               $SUPPRESS -D${IO_BUS} -D${LINKS} \
               ${HAVE_MPD_RING} -I${MTHOME}/include $OPT_FLAG"

# Prelogue
make distclean &>/dev/null

# Configure MVAPICH

echo "Configuring MVAPICH..."

./configure --with-device=vapi --with-arch=LINUX -prefix=${PREFIX} \
	--without-romio --with-mpe \
   	-lib="-L${MTHOME_LIB} -lmtl_common -lvapi -lmosal -lmpga -lpthread" \
    	2>&1 |tee config-mine.log
ret=$?
test $ret = 0 ||  die "configuration."

# Build MVAPICH
echo "Building MVAPICH..."
make 2>&1 |tee make-mine.log 
ret=$?
test $ret = 0 ||  die "building MVAPICH."

# Install MVAPICH
echo "MVAPICH installation..."
rm -f install-mine.log 
make install 2>&1 |tee install-mine.log
ret=$?
test $ret = 0 ||  die "installing MVAPICH."