[mvapich-discuss] OpenFabrics

Di Domenico, Michael mdidomenico at silverstorm.com
Fri Aug 4 23:12:00 EDT 2006


Here's the output from the re-compile with your options...

I might be able to get you one these boxes, I'll look into on Monday.


[root at tse81 mvapich-0.9.8]# export ARCH=_EM64T_
[root at tse81 mvapich-0.9.8]# ./make.mvapich.gen2

Detected the following HCAs:

1) mthca0 [ Mellanox PCI-X ]

For all options enter 0

Please choose the HCA you want to optimize MVAPICH for:
==> 1
Using _MLX_PCI_X_
./make.mvapich.gen2: line 75: export: `-DDISABLE_RMB': not a valid
identifier
Configuring MVAPICH...
Configuring with args --with-device=ch_gen2 --with-arch=LINUX
-prefix=/usr/local/mvapich --without-romio --without-mpe -
lib=-L/usr/local/ofed/lib -Wl,-rpath=/usr/local/ofed/lib -libverbs
-lpthread
Configuring MPICH Version 1.2.7 (release) of : 2005/06/22 16:33:49
Make will not build MPE routines
checking whether filesystem respects case in file names... yes
checking for current directory name... /root/mvapich-0.9.8
checking for install
checking for ranlib
checking for gnumake... yes using --no-print-directory
checking whether make supports include... yes
checking for OSF V3 make... no
checking for virtual path format... VPATH
checking whether g++ returns correct error code... yes
checking whether selected C++ compiler can compile iostream.h... yes

Include C++ bindings for MPI from http://www.osl.iu.edu/research/mpi2c++
Send bug reports about the C++ to mpi2cpp-devel at osl.iu.edu

checking for g++ compiler exception flags... -fexceptions
checking for cc... no
checking whether the compiler gcc accepts ANSI prototypes... yes
checking for g77... found /usr/bin/g77 (1)
checking for ar... found /usr/bin/ar (ar)
checking for whether compiler works... yes
checking whether the compiler gcc accepts ## for concatenation in cpp...
yes
checking whether the compiler gcc accepts const modifier... yes
checking for extension on executables... none
checking how to run the C preprocessor
checking for AIX
checking for minix/config.h
checking for volatile... yes
Running device-specific setup program
setup_ch_gen2 starts... -D_EM64T_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE
-DVIADEV_RPUT_SUPPORT -DLAZY_MEM_UNREGISTER -DC
H_GEN2 -D_SMP_ -D_SMP_RNDV_ -D_MLX_PCI_X_ -I/usr/local/ofed/include -O3
About to do ch_gen2 device
Configuring ch_gen2 subsystem...
No addition setup since mpd is not enabled
Use ${exec_prefix}/bin to set up variables MPIBOOT and MPIUNBOOT
checking whether cross-compiling... no
checking for gethrtime... no
checking for clock_gettime... no
checking for clock_getres... no
checking for how many arguments gettimeofday takes... two - whew
checking for signal.h... yes
checking for sigaction... yes
checking for for struct sigaction... yes
checking for weak symbol support... pragma weak
checking whether weak symbols are visible to other files... yes
checking for remsh... no
checking for rsh... found /usr/kerberos/bin/rsh (rsh)
checking for perl5... no
checking for perl... found /usr/bin/perl (perl)
checking for byte ordering... little endian
checking for uname... yes
checking for netdb.h... yes
checking for gethostbyname... yes
checking whether C++ compiler also has gethostbyname... yes
checking whether Fortran programs can link with needed C functions...
yes
checking whether C++ programs can link with needed C functions... yes
checking for catopen... yes
checking for catclose... yes
checking for catgets... yes
checking for gencat... found /usr/bin/gencat (1)
checking for nl_types.h... yes
checking for ANSI C header files
checking for stdlib.h... yes
checking for string.h... yes
checking for unistd.h... yes
checking for stdarg.h... yes
checking whether stdarg is oldstyle... no
checking whether stdarg is correct... yes
checking whether programs using stdarg link... yes
checking for malloc return type... void
checking for system... yes
checking for nice... yes
checking for strdup... yes
checking for memory.h... yes
checking for sys/ioctl.h... yes
checking for sys/sockio.h... no
checking whether the compiler gcc runs... yes
checking whether the compiler g77 runs... yes
checking for correct handling of conditionals...... yes
checking for correct handling of conditionals part 2 ...... yes
checking for correct handling of #elif... yes
checking that constant folding in arrays works... yes
checking that structs are handled properly... yes
checking that compiler truncates unsigned char correctly ...... yes
checking that compiler/hardware has commutative arithmetic ...... yes
checking that compiler assigns to char correctly ...... yes
checking that compiler does not call unknown routines for long
doubles... yes
checking that compiler accepts args correctly ...... yes
checking whether ranlib works... yes
checking for broken handling of common symbols... no
checking for ar... found /usr/bin/ar (1)
checking for size of void *... 8
checking for pointers greater than 32 bits... yes
checking for size of int... 4
checking for int large enough for pointers... no
checking for C integer type for MPI_Aint...
checking for size of long... 8
C integer type for MPI_Aint is... long
checking for long long... yes
checking whether compiler can handle loops with long long... yes
checking for long double... yes
checking for size of double... 8
checking for size of long double... 16
checking for structure alignment... largest
checking for sync... found /bin/sync (1)
checking whether mpich can be used as the library name... yes
Configuring Fortran subsystem
Configure in /root/mvapich-0.9.8/src/fortran creating cache
./config.cache
checking for cc... gcc
checking whether the C compiler (gcc -D_EM64T_ -DEARLY_SEND_COMPLETION
-DMEMORY_SCALE -DVIADEV_RPUT_SUPPORT -DLAZY_MEM_U
NREGISTER -DCH_GEN2 -D_SMP_ -D_SMP_RNDV_ -D_MLX_PCI_X_
-I/usr/local/ofed/include -O3 -DHAVE_MPICHCONF_H ) works... yes
checking whether the C compiler (gcc -D_EM64T_ -DEARLY_SEND_COMPLETION
-DMEMORY_SCALE -DVIADEV_RPUT_SUPPORT -DLAZY_MEM_U
NREGISTER -DCH_GEN2 -D_SMP_ -D_SMP_RNDV_ -D_MLX_PCI_X_
-I/usr/local/ofed/include -O3 -DHAVE_MPICHCONF_H ) is a cross-co
mpiler... no
checking whether the C compiler sets its return status correctly... yes
checking whether we are using GNU C... yes
checking for working const... yes
checking whether the Fortran 77 compiler (g77 -L/usr/local/ofed/lib )
works... yes
checking whether the Fortran 77 compiler (g77 -L/usr/local/ofed/lib ) is
a cross-compiler... no
checking whether we are using GNU Fortran 77... yes
checking whether g77 accepts -g... yes
checking for f90... no
checking for xlf90... no
checking for pgf90... no
checking for ifort... no
checking for epcf90... no
checking for f95... no
checking for fort... no
checking for xlf95... no
checking for lf95... no
checking for pathf90... no
checking for g95... no
checking for fc... no
checking for ifc... no
checking for efc... no
configure: warning: no acceptable Fortran 90 compiler found in $PATH
checking for make... make
checking whether clock skew breaks make... no
checking whether make supports include... yes
checking whether make allows comments in actions... yes
checking for virtual path format... VPATH
checking whether make sets CFLAGS... yes
checking for ranlib... ranlib
checking how to run the C preprocessor... gcc -E
checking for routines to access the command line from Fortran 77...
searching...
checking whether g77   works with GETARG and IARGC... yes
checking host system type... ia64-unknown-linux-gnu
checking for Fortran 77 libraries...
-L/usr/lib/gcc/ia64-redhat-linux/3.4.5
-L/usr/lib/gcc/ia64-redhat-linux/3.4.5/../.
./.. -lfrtbegin -lg2c -lm -lgcc_s
checking whether C can link with  -L/usr/lib/gcc/ia64-redhat-linux/3.4.5
-L/usr/lib/gcc/ia64-redhat-linux/3.4.5/../../..
 -lfrtbegin -lg2c -lm -lgcc_s... yes
checking for linker for Fortran main programs... Use Fortran to link
programs
checking for Fortran 77 name mangling... lower doubleunderscore
checking for which Fortran libraries are needed to link C with
Fortran... none
checking whether Fortran accepts ! for comments... yes
checking whether Fortran supports new-style character declarations...
yes
checking for include directory flag for Fortran... -I
checking for Fortran 77 flag for library directories... -L
checking whether Fortran has pointer declaration... no
checking for size of Fortran type integer... 4
checking for size of Fortran type real... 4
checking for size of Fortran type double precision... 8
checking for ANSI C header files... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for stdarg.h... yes
checking whether stdarg is oldstyle... no
checking whether stdarg works... yes
checking size of char... 1
checking size of short... 2
checking size of int... 4
checking size of long... 8
checking size of long long... 8
checking size of float... 4
checking size of double... 8
checking size of long double... 16
checking size of void*... 8
checking for C type matching Fortran integer*1... char
checking for C type matching Fortran integer*2... short
checking for C type matching Fortran integer*4... int
checking for C type matching Fortran integer*8... long
checking for C type matching Fortran real*4... float
checking for C type matching Fortran real*8... double
checking for C type matching Fortran integer... int
checking whether C compiler allows unaligned doubles... yes
checking for type of weak symbol support... pragma weak
checking whether __attribute__ ((weak)) allowed... yes
checking for values of Fortran logicals... True is 1 and False is 0
checking for Fortran 90 integer kind for 8-byte integers... unavailable
checking for Fortran 90 integer kind for 8-byte integers... -1 (cached)
checking for Fortran 90 integer kind for 4-byte integers... unavailable
configure: warning: Unable to determine the size of a simple integer
configure: warning: Using 4 for the Fortran 90 KIND of an MPI_Aint
configure: warning: Using 4 for the Fortran 90 KIND of an MPI_Offset
checking whether using gcc and g77 together... yes
updating cache ./config.cache
creating ./config.status
creating Makefile
creating src/Makefile
creating src/farg.f
creating include/mpif.h
creating include/mpi_fortdefs.h
creating src/mpif77
creating src/mpif77.conf
creating src/mpif90
creating src/mpif90.conf
creating src/initfcmn.f
creating src/initfdte.f
creating mpi_fortconf.h
Done configuring Fortran subsystem
checking whether head command is broken... no
creating config.status
creating Makefile
creating util/Makefile
creating examples/Makefile
creating src/pt2pt/Makefile
creating src/coll/Makefile
creating src/context/Makefile
creating src/dmpi/Makefile
creating src/env/Makefile
creating src/topol/Makefile
creating src/profile/Makefile
creating src/coll2/Makefile
creating src/util/Makefile
creating src/infoexport/Makefile
creating examples/basic/Makefile
creating src/misc2/Makefile
creating src/external/Makefile
creating mpichconf.h
creating util/mpicc
creating util/mpicxx
creating util/mpiinstall
creating util/mpirun
creating util/mpichlib.conf
creating util/mpiman
creating util/chkserv
creating util/chkmachine
creating util/tstmachines
creating include/mpidefs.h
creating include/mpif.f90
Configuring the test suite...
Configuring with args -basecc=gcc -cc=/root/mvapich-0.9.8/bin/mpicc
-make=make --no-print-directory -device=ch_gen2 -mpi
chpath=/root/mvapich-0.9.8/bin --enable-boot -cflags=-D_EM64T_
-DEARLY_SEND_COMPLETION -DMEMORY_SCALE -DVIADEV_RPUT_SUPP
ORT -DLAZY_MEM_UNREGISTER -DCH_GEN2 -D_SMP_ -D_SMP_RNDV_ -D_MLX_PCI_X_
-I/usr/local/ofed/include -O3 -DHAVE_MPICHCONF_H
-basefc=g77  -fc=/root/mvapich-0.9.8/bin/mpif77 --disable-io
checking whether cross-compiling... no
checking whether the compiler gcc runs... yes
checking whether the compiler g77 runs... yes
checking whether we are using GNU Fortran 77... yes
checking for gnumake... no
checking whether make supports include... yes
checking for OSF V3 make... no
checking for virtual path format... VPATH
checking for stdlib.h... yes
checking for unistd.h... yes
checking for string.h... yes
checking for stdarg is correct... yes
checking for long double... yes
checking for long long... yes
checking whether compiler can handle loops with long long... yes
checking whether the compiler gcc accepts ANSI prototypes... yes
checking for signal.h... yes
checking for sigaction... yes
checking for sleep... yes
checking for sysconf... yes
checking for sizeof MPI_Offset... 0
checking for libraries needed for Fortran command line access... unable
to determine
creating config.status
creating Makefile
creating pt2pt/Makefile
creating coll/Makefile
creating topol/Makefile
creating context/Makefile
creating env/Makefile
creating profile/Makefile
creating pt2pt/runtests
creating coll/runtests
creating topol/runtests
creating context/runtests
creating command/runtests
creating env/runtests
creating profile/runtests
Configuring the performance tests ...
Configure in /root/mvapich-0.9.8/examples/perftest creating cache
./config.cache
checking for a BSD compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking whether make --no-print-directory sets ${MAKE}... yes
checking for working aclocal... found
checking for working autoconf... found
checking for working automake... found
checking for working autoheader... found
checking for working makeinfo... found
checking whether clock skew breaks make... no
checking whether make supports include... yes
checking whether make allows comments in actions... yes
checking for virtual path format... VPATH
checking whether make sets CFLAGS... yes
checking for cit... no
checking for gnuplot... gnuplot
checking how to run the C preprocessor... gcc -E
checking whether C compiler accepts option -O4 -Ofast... no
checking whether C compiler accepts option -Ofast... no
checking whether C compiler accepts option -fast... no
checking whether C compiler accepts option -O3... yes
checking whether routines compiled with -O3 can be linked with ones
compiled  without -O3... yes
checking for library containing fabs... -lm
checking for ANSI C header files... yes
checking for sys/time.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking whether time.h and sys/time.h may both be included... yes
checking whether struct tm is in sys/time.h or time.h... time.h
checking for working const... yes
checking for restrict... __restrict
checking for long long... yes
updating cache ./config.cache
creating ./config.status
creating Makefile
creating mpptestconf.h
creating mpid/ch_gen2/Makefile
creating mpid/tests/Makefile
creating mpichconf.h
mpichconf.h is unchanged
*# --->
*# You should register your copy of MPICH with us by sending mail
*# to majordomo at mcs.anl.gov containing the message
*# subscribe mpi-users
*# This will allow us to notify you of new releases of MPICH.
*#
*# You can also check the MPICH home page at
*# http://www.mcs.anl.gov/mpi/mpich
*# ---<
Configuration completed.
Building MVAPICH...
cleaning src/pt2pt
rm -f *.o *~ /root/mvapich-0.9.8/src/pt2pt/*.o
cleaning src/env
rm -f *.o *~ /root/mvapich-0.9.8/src/env/*.o
cleaning src/dmpi
rm -f *.o *~ /root/mvapich-0.9.8/src/dmpi/*.o
cleaning src/util
rm -f *.o *~ /root/mvapich-0.9.8/src/util/*.o
cleaning src/context
rm -f *.o *~ /root/mvapich-0.9.8/src/context/*.o
cleaning src/coll
rm -f *.o *~ /root/mvapich-0.9.8/src/coll/*.o
cleaning src/topol
rm -f *.o *~ /root/mvapich-0.9.8/src/topol/*.o
cleaning src/profile
rm -f *.o *~ /root/mvapich-0.9.8/src/profile/*.o
cleaning src/misc2
rm -f *.o *~ /root/mvapich-0.9.8/src/misc2/*.o
cleaning src/external
rm -f *.o *~ /root/mvapich-0.9.8/src/external/*.o
cleaning mpid/ch_gen2
/bin/rm -f *.o *.d *~ process/*~ process/*.d process/*.o  \
    process/mpirun_rsh process/core viainit.o viasend.o viarecv.o
viacheck.o viapriv.o viaparam.o viutil.o vbuf.o cm_use
r.o mpid_init.o mpid_send.o mpid_recv.o cm.o mpid_hsend.o mpid_hrecv.o
mpid_pack.o cmnargs.o mpid_misc.o dreg.o mpid_smp
i.o collutils.o intra_rdma_barrier.o mpid_mcast.o mcst_grp.o ibmcgrp.o
crc32h.o avl.o queue.o sbcnst2.o tr2.o \
    queue.c sbcnst2.c tr2.c sbcnst2.h tr2.h core ibmcgrp/*.o
ibmcgrp/ibmcgrp /root/mvapich-0.9.8/bin/ibmcgrp
cleaning examples
rm -f sendchar *.o

Making clean in directory test

Making clean in directory pt2pt

Making clean in directory coll

Making clean in directory topol

Making clean in directory env

Making clean in directory context

Making clean in directory profile

Making clean in directory perftest
test -z "mpptest goptest buflimit " || rm -f mpptest goptest buflimit
rm -f *.o core *.core
rm -f tunepkt pktuse copytest vectest stress ctest cluster tcomm
rm -f work.pc work.pcl
cleaning examples/basic
rm -f work.pc work.pcl
rm -f *.o *~ PI* cpi systest srtest  fpi cpilog cpi_autolog hello++
iotest pi3f90  upshot rdb.* startup.* core
rm -f hello++.ti hello++.ii
cleaning examples/test/pt2pt
cleaning examples/test/coll
cleaning examples/test/topol
cleaning examples/test/context
cleaning examples/test/env
cleaning examples/test/profile
cleaning examples/test

Making clean in directory pt2pt

Making clean in directory coll

Making clean in directory topol

Making clean in directory env

Making clean in directory context

Making clean in directory profile
cleaning examples/perftest
test -z "mpptest goptest buflimit " || rm -f mpptest goptest buflimit
rm -f *.o core *.core
rm -f tunepkt pktuse copytest vectest stress ctest cluster tcomm
rm -f work.pc work.pcl
cleaning src/infoexport
rm -f *.o
rm -f *.i
rm -f *.s
rm -f *.cxx.log
rm -f *.cxx.errors
rm -f libtvmpich.so.1.0
rm -f libtvmpich.so*
rm -f /root/mvapich-0.9.8/src/infoexport/*.o
rm -f *~ *.o aditest1 aditest2 aditest3 aditest4 aditest5 aditest6
aditest7 aditest8 aditest9 aditest10 aditest11 adites
t12 aditest13 timers trunc
rm -f /root/mvapich-0.9.8/lib/lib*.a
rm -f /root/mvapich-0.9.8/lib/shared/lib*.so*
make --no-print-directory mpi-modules
make --no-print-directory mpilib
for file in queue.c sbcnst2.c tr2.c sbcnst2.h tr2.h ; do  \
    if [ ! -s $file ] ; then   \
       ln -s ../util/$file;    \
    fi;                         \
done

making mpir in directory mpid/ch_gen2
for file in queue.c sbcnst2.c tr2.c sbcnst2.h tr2.h ; do  \
    if [ ! -s $file ] ; then   \
       ln -s ../util/$file;    \
    fi;                         \
done
gcc -DHAVE_CONFIG_H -I. -I/root/mvapich-0.9.8/mpid/ch_gen2
-I/root/mvapich-0.9.8/include -I/root/mvapich-0.9.8/include -
I/root/mvapich-0.9.8/mpid/ch_gen2 -I/root/mvapich-0.9.8/mpid/util
-DMPID_DEVICE_CODE  -DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -D
HAVE_GETHOSTBYNAME=1  -DMPID_DEBUG_NONE -DMPID_STAT_NONE  -D_EM64T_
-DEARLY_SEND_COMPLETION -DMEMORY_SCALE -DVIADEV_RPUT
_SUPPORT -DLAZY_MEM_UNREGISTER -DCH_GEN2 -D_SMP_ -D_SMP_RNDV_
-D_MLX_PCI_X_  -I/usr/local/ofed/include -O3 -DHAVE_MPICHC
ONF_H -D_GNU_SOURCE -I/root/mvapich-0.9.8
-I/root/mvapich-0.9.8/mpid/ch_gen2 -I.  -Wall  -c viainit.c
gcc -DHAVE_CONFIG_H -I. -I/root/mvapich-0.9.8/mpid/ch_gen2
-I/root/mvapich-0.9.8/include -I/root/mvapich-0.9.8/include -
I/root/mvapich-0.9.8/mpid/ch_gen2 -I/root/mvapich-0.9.8/mpid/util
-DMPID_DEVICE_CODE  -DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -D
HAVE_GETHOSTBYNAME=1  -DMPID_DEBUG_NONE -DMPID_STAT_NONE  -D_EM64T_
-DEARLY_SEND_COMPLETION -DMEMORY_SCALE -DVIADEV_RPUT
_SUPPORT -DLAZY_MEM_UNREGISTER -DCH_GEN2 -D_SMP_ -D_SMP_RNDV_
-D_MLX_PCI_X_  -I/usr/local/ofed/include -O3 -DHAVE_MPICHC
ONF_H -D_GNU_SOURCE -I/root/mvapich-0.9.8
-I/root/mvapich-0.9.8/mpid/ch_gen2 -I.  -Wall  -c viasend.c
gcc -DHAVE_CONFIG_H -I. -I/root/mvapich-0.9.8/mpid/ch_gen2
-I/root/mvapich-0.9.8/include -I/root/mvapich-0.9.8/include -
I/root/mvapich-0.9.8/mpid/ch_gen2 -I/root/mvapich-0.9.8/mpid/util
-DMPID_DEVICE_CODE  -DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -D
HAVE_GETHOSTBYNAME=1  -DMPID_DEBUG_NONE -DMPID_STAT_NONE  -D_EM64T_
-DEARLY_SEND_COMPLETION -DMEMORY_SCALE -DVIADEV_RPUT
_SUPPORT -DLAZY_MEM_UNREGISTER -DCH_GEN2 -D_SMP_ -D_SMP_RNDV_
-D_MLX_PCI_X_  -I/usr/local/ofed/include -O3 -DHAVE_MPICHC
ONF_H -D_GNU_SOURCE -I/root/mvapich-0.9.8
-I/root/mvapich-0.9.8/mpid/ch_gen2 -I.  -Wall  -c viarecv.c
gcc -DHAVE_CONFIG_H -I. -I/root/mvapich-0.9.8/mpid/ch_gen2
-I/root/mvapich-0.9.8/include -I/root/mvapich-0.9.8/include -
I/root/mvapich-0.9.8/mpid/ch_gen2 -I/root/mvapich-0.9.8/mpid/util
-DMPID_DEVICE_CODE  -DHAVE_UNAME=1 -DHAVE_NETDB_H=1 -D
HAVE_GETHOSTBYNAME=1  -DMPID_DEBUG_NONE -DMPID_STAT_NONE  -D_EM64T_
-DEARLY_SEND_COMPLETION -DMEMORY_SCALE -DVIADEV_RPUT
_SUPPORT -DLAZY_MEM_UNREGISTER -DCH_GEN2 -D_SMP_ -D_SMP_RNDV_
-D_MLX_PCI_X_  -I/usr/local/ofed/include -O3 -DHAVE_MPICHC
ONF_H -D_GNU_SOURCE -I/root/mvapich-0.9.8
-I/root/mvapich-0.9.8/mpid/ch_gen2 -I.  -Wall  -c viacheck.c
/tmp/cclNTwmX.s: Assembler messages:
/tmp/cclNTwmX.s:147: Error: Unknown opcode `lfence'
/tmp/cclNTwmX.s:5474: Error: Unknown opcode `lfence'
/tmp/cclNTwmX.s:6508: Error: Unknown opcode `lfence'
/tmp/cclNTwmX.s:7248: Error: Unknown opcode `lfence'
make[3]: *** [viacheck.o] Error 1
Exit status from make was 2
make[2]: *** [mpilib] Error 1
make[1]: *** [mpi-modules] Error 2
make: *** [mpi] Error 2
MVAPICH installation...
rm -f /root/mvapich-0.9.8/bin/mpireconfig.dat
rm -f /root/mvapich-0.9.8/bin/mpireconfig.dat
creating util/mympiinstall
if [ "/usr/local/mvapich" = "/usr/local/mvapich" ] ; then \
    ./bin/mpiinstall  ; \
else \
    ./bin/mpiinstall -prefix=/usr/local/mvapich  ; \
fi
You must make MPI before installing it!
Could not find /root/mvapich-0.9.8/lib/libmpich.a !
make: *** [install] Error 1
[root at tse81 mvapich-0.9.8]#








-----Original Message-----
From: Sayantan Sur [mailto:surs at cse.ohio-state.edu] 
Sent: Friday, August 04, 2006 5:57 PM
To: Di Domenico, Michael
Cc: mvapich-discuss at cse.ohio-state.edu
Subject: Re: [mvapich-discuss] OpenFabrics

Di Domenico, Michael wrote:

>Looks like xhpl won't run either.  Looking at the switch it sends about
>40 packets and hangs.  No errors on the switch, but this comes out in
>dmesg on the host.
>  
>
Hmm. Could you try re-compiling MVAPICH as per follows:

$ export ARCH=_EM64T_
$ ... edit make.mvapich.gen2 and put -DDISABLE_RMB in CFLAGS ...
$ ./make.mvapich.gen2

Could you let us know if that helps? I don't have a IA64 machine around 
here. Would it be possible to get access to yours? Also, does the 
MVAPICH version which comes along with OFED work on your machines?

Thanks,
Sayantan.

-- 
http://www.cse.ohio-state.edu/~surs




More information about the mvapich-discuss mailing list