[Mvapich-discuss] Issues of benchmarks

[Paniraja Guptha, Akshay]

The benchmarks function properly with MVAPICH-GDR.

The failures seem to be attributed to the MPI library that the user is utilizing, and this issue has been communicated to the user.

-Akshay

From: Mvapich-discuss <mvapich-discuss-bounces+panirajaguptha.1=osu.edu at lists.osu.edu> On Behalf Of cx p via Mvapich-discuss
Sent: Friday, May 17, 2024 6:25 AM
To: mvapich-discuss at lists.osu.edu
Subject: [Mvapich-discuss] Issues of benchmarks

Hello， When I use one-sided benchmarks that osu_fop_latency, osu_cas_latency and osu_acc_latency that related to atomic operations with device memory, issues occurred. My environment is shown as picture: . Benchmark command line is : mpirun
ZjQcmQRYFpfptBannerStart
This Message Is From an External Sender
This message came from outside your organization.
    Report Suspicious  <https://us-phishalarm-ewt.proofpoint.com/EWT/v1/KGKeukY!vYQd06grTwoNIdn7n23qPHUppp5kQwnEmfQKmns6Qbu6kovGPSG1Exl9cAmlIGIeffbTkv1Q02Qk4jWDRqVjwxVe1RaSxoFrJ27DwkGYWT-JpSXwA5xDfTX_4ghSzbJYyE6qiA$>   ‌
ZjQcmQRYFpfptBannerEnd
Hello，

When I use one-sided benchmarks that osu_fop_latency, osu_cas_latency and osu_acc_latency that related to atomic operations with device memory, issues occurred.

My environment is shown as picture:
    [cid:image001.png at 01DAAB66.62E80E40]  .
Benchmark command line is :
    mpirun --allow-run-as-root -np 2 -H h800-125:1,h800-129:1 -x UCX_NET_DEVICES=mlx5_0:1 -x LD_LIBRARY_PATH /opt/hpc/software/osu-micro-benchmarks-7.4/mpi/one-sided/osu_fop_latency -d cuda D H
       or
    mpirun --allow-run-as-root -np 2 -H h800-125:1,h800-129:1 -x UCX_NET_DEVICES=mlx5_0:1 -x LD_LIBRARY_PATH /opt/hpc/software/osu-micro-benchmarks-7.4/mpi/one-sided/osu_fop_latency -d cuda D D .

Runtime error !  But Using "H D" is ok.
    [cid:image002.png at 01DAAB66.62E80E40]

Does rank 0 not supported to use GPU memory in atomic operation ？

Thank you ！
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osu.edu/pipermail/mvapich-discuss/attachments/20240521/7de16271/attachment-0002.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 73664 bytes
Desc: image001.png
URL: <http://lists.osu.edu/pipermail/mvapich-discuss/attachments/20240521/7de16271/attachment-0004.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 432367 bytes
Desc: image002.png
URL: <http://lists.osu.edu/pipermail/mvapich-discuss/attachments/20240521/7de16271/attachment-0005.png>