[mvapich-discuss] Issue building MVAPICH2 2.3.2 with CUDA support

[Dockendorf, Trey]

Full configure line:

Configuring MVAPICH2 version 2.3.2 with  '--prefix=/opt/mvapich2/gnu/4.8/2.3.2-gpu' '--enable-shared' '--with-mpe' '--enable-romio' '--enable-mpit-pvars=mv2' '--disable-option-checking' '--with-file-system=ufs+nfs+gpfs+ime' '--with-pbs=/opt/torque' '--with-pbs-lib=/opt/torque/lib64' '--with-pbs-include=/opt/torque/include' '--enable-cuda' '--with-cuda-include=/apps/cuda/10.1.168/include' '--with-cuda-libpath=/apps/cuda/10.1.168/lib64' 'CC=gcc' 'CFLAGS=-I/opt/ddn/ime/include' 'LDFLAGS=-Wl,-rpath,/opt/ddn/ime/lib -L/opt/ddn/ime/lib -lim_client -lim_common -lim_net_cci -lulockmgr -L/apps/cuda/10.1.168/lib64' 'CXX=g++' 'FC=gfortran' 'F77=gfortran'

I have tried CUDA 10.0.130 and 10.1.168.  The error is below. We use a script to build mvapich2 and this was not an issue with 2.3.1 and CUDA 10.0.130.

  CC       src/mpi/coll/lib_libmpi_la-allgather_cuda_osu.lo
In file included from ./src/include/mpit.h:14:0,
                 from ./src/include/mpiimpl.h:3675,
                 from src/mpi/coll/allgather_cuda_osu.c:18:
src/mpi/coll/allgather_cuda_osu.c: In function ‘MPIR_Allgather_cuda_intra_MV2’:
./src/include/mpitimpl.h:979:39: error: ‘PVAR_TIMER_mv2_coll_timer_allgather_cuda’ undeclared (first use in this function)
     MPIR_T_PVAR_TIMER_START_VAR_impl(&PVAR_TIMER_##name_)
                                       ^
./src/include/mpitimpl.h:244:13: note: in definition of macro ‘PVAR_GATED_ACTION’
             action_; \
             ^
./src/include/mpitimpl.h:979:5: note: in expansion of macro ‘MPIR_T_PVAR_TIMER_START_VAR_impl’
     MPIR_T_PVAR_TIMER_START_VAR_impl(&PVAR_TIMER_##name_)
     ^
./src/include/mpit.h:487:31: note: in expansion of macro ‘MPIR_T_PVAR_TIMER_START_impl’
     PVAR_GATED_ACTION(MODULE, MPIR_T_PVAR_TIMER_START_impl(name_))
                               ^
./src/include/mpitimpl.h:1502:14: note: in expansion of macro ‘MPIR_T_PVAR_TIMER_START’
              MPIR_T_PVAR_TIMER_START(MV2,mv2_##_optype##_timer_##_op##_##_algo);                 \
              ^
src/mpi/coll/allgather_cuda_osu.c:50:5: note: in expansion of macro ‘MPIR_TIMER_START’
     MPIR_TIMER_START(coll,allgather,cuda);
     ^
./src/include/mpitimpl.h:979:39: note: each undeclared identifier is reported only once for each function it appears in
     MPIR_T_PVAR_TIMER_START_VAR_impl(&PVAR_TIMER_##name_)
                                       ^
./src/include/mpitimpl.h:244:13: note: in definition of macro ‘PVAR_GATED_ACTION’
             action_; \
             ^
./src/include/mpitimpl.h:979:5: note: in expansion of macro ‘MPIR_T_PVAR_TIMER_START_VAR_impl’
     MPIR_T_PVAR_TIMER_START_VAR_impl(&PVAR_TIMER_##name_)
     ^
./src/include/mpit.h:487:31: note: in expansion of macro ‘MPIR_T_PVAR_TIMER_START_impl’
     PVAR_GATED_ACTION(MODULE, MPIR_T_PVAR_TIMER_START_impl(name_))
                               ^
./src/include/mpitimpl.h:1502:14: note: in expansion of macro ‘MPIR_T_PVAR_TIMER_START’
              MPIR_T_PVAR_TIMER_START(MV2,mv2_##_optype##_timer_##_op##_##_algo);                 \
              ^
src/mpi/coll/allgather_cuda_osu.c:50:5: note: in expansion of macro ‘MPIR_TIMER_START’
     MPIR_TIMER_START(coll,allgather,cuda);
     ^
make[2]: *** [src/mpi/coll/lib_libmpi_la-allgather_cuda_osu.lo] Error 1
make[2]: Leaving directory `/dev/shm/tmp.w4vmy3cziM'
make[1]: *** [install-recursive] Error 1
make[1]: Leaving directory `/dev/shm/tmp.w4vmy3cziM'
make: *** [install] Error 2

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20191017/ac1638d5/attachment.html>