[mvapich-discuss] -with-coll configure option not working

[Hari Subramoni]

Hi Dan,

We would recommend executing an un-modified version of make.mvapich.gen2
and setting the environment variable VIADEV_USE_SHMEM_COLL to 0 at
runtime.

We also have many options which allows you to selectively disable the
newer collectives. Section 9.7.1 thru 9.7.4 of the MVAPICH 1.1 user guide
describes the necessary settings you need to make to achieve this. I've
given the link below for your reference.

http://mvapich/support/mvapich_user_guide-1.1.html#x1-1350009.7.1

Thx,
Hari.

On Fri, 23 Jan 2009, Dan Kokron wrote:

> I attempted to compile mvapich-1.1 on an Intel cluster using the older
> collective routines (--with-coll=intra_fns).  The build
> (./make.mvapich.gen2) failed with the following ...
>
> make overtake
> /u/dkokron/play/mvapich-1.1/bin/mpicc -D_EM64T_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE -DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DXRC -DCH_GEN2 -D_GNU_SOURCE -D__INTEL_COMPILER -I/usr/include -O3 -DHAVE_MPICHCONF_H  -DHAVE_STDLIB_H=1 -DHAVE_UNISTD_H=1 -DHAVE_STRING_H=1 -DUSE_STDARG=1 -DHAVE_LONG_DOUBLE=1 -DHAVE_LONG_LONG_INT=1 -DHAVE_PROTOTYPES=1 -DHAVE_SIGNAL_H=1 -DHAVE_SIGACTION=1 -DHAVE_SLEEP=1 -DHAVE_SYSCONF=1   -c overtake.c
> overtake.c(189): (col. 2) remark: LOOP WAS VECTORIZED.
> overtake.c(223): (col. 2) remark: LOOP WAS VECTORIZED.
> overtake.c(234): (col. 2) remark: LOOP WAS VECTORIZED.
> overtake.c(243): (col. 2) remark: LOOP WAS VECTORIZED.
> overtake.c(255): (col. 2) remark: LOOP WAS VECTORIZED.
> overtake.c(263): (col. 2) remark: LOOP WAS VECTORIZED.
> overtake.c(173): (col. 5) remark: LOOP WAS VECTORIZED.
> overtake.c(47): (col. 5) remark: LOOP WAS VECTORIZED.
> /u/dkokron/play/mvapich-1.1/bin/mpicc -D_EM64T_ -DEARLY_SEND_COMPLETION -DMEMORY_SCALE -DVIADEV_RPUT_SUPPORT -D_SMP_ -D_SMP_RNDV_ -DXRC -DCH_GEN2 -D_GNU_SOURCE -D__INTEL_COMPILER -I/usr/include -O3 -DHAVE_MPICHCONF_H  -DHAVE_STDLIB_H=1 -DHAVE_UNISTD_H=1 -DHAVE_STRING_H=1 -DUSE_STDARG=1 -DHAVE_LONG_DOUBLE=1 -DHAVE_LONG_LONG_INT=1 -DHAVE_PROTOTYPES=1 -DHAVE_SIGNAL_H=1 -DHAVE_SIGACTION=1 -DHAVE_SLEEP=1 -DHAVE_SYSCONF=1   -c test.c
> /u/dkokron/play/mvapich-1.1/bin/mpicc  -o overtake overtake.o test.o
> /u/dkokron/play/mvapich-1.1/lib/libmpich.a(initutil.o): In function `MPIR_Init':
> initutil.c:(.text+0xf2): undefined reference to `disable_shmem_barrier'
> initutil.c:(.text+0x11c): undefined reference to `disable_shmem_reduce'
> initutil.c:(.text+0x146): undefined reference to `disable_shmem_allreduce'
> initutil.c:(.text+0x170): undefined reference to `disable_shmem_bcast'
> initutil.c:(.text+0x290): undefined reference to `shmem_coll_reduce_threshold'
> initutil.c:(.text+0x2ad): undefined reference to `shmem_coll_allreduce_threshold'
> initutil.c:(.text+0x2ca): undefined reference to `shmem_coll_bcast_threshold'
> initutil.c:(.text+0x2d6): undefined reference to `shmem_coll_reduce_threshold'
> initutil.c:(.text+0x2e2): undefined reference to `shmem_coll_allreduce_threshold'
> initutil.c:(.text+0x316): undefined reference to `allgather_large_msg_threshold'
> initutil.c:(.text+0x344): undefined reference to `allgather_small_msg_threshold'
> initutil.c:(.text+0x36c): undefined reference to `bcast_knomial_degree'
> /u/dkokron/play/mvapich-1.1/lib/libmpich.a(context_util.o): In function `MPIR_Context_alloc':
> context_util.c:(.text+0x2f): undefined reference to `disable_shmem_allreduce'
> context_util.c:(.text+0x3f): undefined reference to `disable_shmem_allreduce'
> context_util.c:(.text+0x8b): undefined reference to `disable_shmem_allreduce'
> context_util.c:(.text+0xaf): undefined reference to `disable_shmem_allreduce'
> context_util.c:(.text+0xbf): undefined reference to `disable_shmem_allreduce'
> /u/dkokron/play/mvapich-1.1/lib/libmpich.a(context_util.o):context_util.c:(.text+0x102): more undefined references to `disable_shmem_allreduce' follow
> /u/dkokron/play/mvapich-1.1/lib/libmpich.a(context_util.o): In function `MPIR_Context_alloc':
> context_util.c:(.text+0x171): undefined reference to `disable_shmem_bcast'
> context_util.c:(.text+0x181): undefined reference to `disable_shmem_bcast'
> context_util.c:(.text+0x1bb): undefined reference to `disable_shmem_bcast'
> /u/dkokron/play/mvapich-1.1/lib/libmpich.a(comm_rdma_init.o): In function `comm_rdma_init':
> comm_rdma_init.c:(.text+0x563): undefined reference to `disable_shmem_barrier'
>
>
> The config-mine.log file is attached.
>
> --
> Dan Kokron
> Global Modeling and Assimilation Office
> NASA Goddard Space Flight Center
> Greenbelt, MD 20771
> Daniel.S.Kokron at nasa.gov
> Phone: (301) 614-5192
> Fax:   (301) 614-5304
>