[Mvapich-discuss] Issues of benchmarks

[cx p]

Hello，

When I use one-sided benchmarks that osu_fop_latency, osu_cas_latency and
osu_acc_latency that related to atomic operations with device memory,
issues occurred.

My environment is shown as picture:
    [image: image.png] .
Benchmark command line is :
    mpirun --allow-run-as-root -np 2 -H h800-125:1,h800-129:1 -x
UCX_NET_DEVICES=mlx5_0:1 -x LD_LIBRARY_PATH
/opt/hpc/software/osu-micro-benchmarks-7.4/mpi/one-sided/osu_fop_latency -d
cuda *D H*
       or
    mpirun --allow-run-as-root -np 2 -H h800-125:1,h800-129:1 -x
UCX_NET_DEVICES=mlx5_0:1 -x LD_LIBRARY_PATH
/opt/hpc/software/osu-micro-benchmarks-7.4/mpi/one-sided/osu_fop_latency -d
cuda *D D* .

Runtime error !  But Using "H D" is ok.
    [image: image.png]

Does rank 0 not supported to use GPU memory in atomic operation ？

Thank you ！
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osu.edu/pipermail/mvapich-discuss/attachments/20240517/0672d643/attachment-0002.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 73664 bytes
Desc: not available
URL: <http://lists.osu.edu/pipermail/mvapich-discuss/attachments/20240517/0672d643/attachment-0004.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 432367 bytes
Desc: not available
URL: <http://lists.osu.edu/pipermail/mvapich-discuss/attachments/20240517/0672d643/attachment-0005.png>