[mvapich-discuss] MVAPICH 2.3a-GDR on POWER8: Run Problems

[Sourav Chakraborty]

Hi Dr. Herten,

Can you please try specifying the number of processes and the hostfile?
Example:

mpirun -np 2 -hostfile $LSB_DJOB_HOSTFILE ./get_local_rank ./osu_bibw D D

mpirun_rsh can also be used in place of mpirun.

mpirun -export -np 2 -hostfile $LSB_DJOB_HOSTFILE ./get_local_rank
./osu_bibw D D

(By default mpirun_rsh does not export the environment variables and
specifying -export option is required.)

Thank you,
Sourav

On Thu, Nov 23, 2017 at 7:45 AM, Herten, Andreas <a.herten at fz-juelich.de>
wrote:

> Dear all,
>
> I’m involved in operation of a POWER8+NVIDIA cluster, JURON, at Jülich
> Supercomputing Centre.
>
> I downloaded the GDR built for POWER but am unable to run CUDA-aware MPI
> applications.
>
> Testing with the packaged OSU microbenchmarks, the program is stuck right
> at the beginning. See below.
>
> JURON runs CentOS with GCC 4.8.5, but we also tested loading GCC 5.4.0. We
> use an EDR InfiniBand interconnect. Our batch system is LSF – is MVAPICH
> built with LSF support?
> Please let me know if you need further information for debugging.
>
> > $ env | grep MV2
> > MV2_ENABLE_AFFINITY=0
> > MV2_USE_CUDA=1
> > MV2_USE_GPUDIRECT_GDRCOPY=0
>
> > $ bsub -n 2 -I -R "rusage[ngpus_shared=20]" mpirun
> /gpfs/software/opt/mvapich2/2.3a-GDR-cuda_8/libexec/osu-
> micro-benchmarks/get_local_rank /gpfs/software/opt/mvapich2/2.
> 3a-GDR-cuda_8/libexec/osu-micro-benchmarks/mpi/pt2pt/osu_bibw D D
> > Job <9706> is submitted to default queue <normal.i>.
> > <<Waiting for dispatch ...>>
> > <<Starting on juronc05>>
> > # OSU MPI-CUDA Bi-Directional Bandwidth Test v5.4.0
> > # Send Buffer on DEVICE (D) and Receive Buffer on DEVICE (D)
> > # Size      Bandwidth (MB/s)
>
> -Andreas
> —
> Dr. Andreas Herten
> NVIDIA Application Lab
> Jülich Supercomputing Centre
> Forschungszentrum Jülich, Germany
> +49 2461 61 1825
>
>
> _______________________________________________
> mvapich-discuss mailing list
> mvapich-discuss at cse.ohio-state.edu
> http://mailman.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20171125/f5c1b4d9/attachment.html>