[mvapich-discuss] Suppressing send work request completions in RNDV RDMA_WRITE

Pagadala Jagadeesh pjagadeesh at cdac.in
Tue Oct 14 08:57:34 EDT 2014


Hi all,

I am trying to understand RNDV protocol in MVAPICH2-1.9 with respect to
RDMA_WRITE operation.
For data size of more than 4MB, each RDMA_WRITE request carries 4M
data and all such send work requests are generating completion entry.
In InfiniBand there is a mechanism to suppress send completion entries(
MVAPICH2-1.9 is enabling this feature when creating a QP using attr.sq_sig_all =
0,
But not using send completion suppression while posting send work request).
In case of RDMA_WRITE (RNDV) we can suppress intermediate send completions,
when last send request completion is generated then we can make sure that
previous send work requests are also completed successfully.

Is there any overhead of suppressing such intermediate send completions?

Thanks & Regards
Jagadeesh
-------------------------------------------------------------------------------------------------------------------------------
[ C-DAC is on Social-Media too. Kindly follow us at:
Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ]

This e-mail is for the sole use of the intended recipient(s) and may
contain confidential and privileged information. If you are not the
intended recipient, please contact the sender by reply e-mail and destroy
all copies and the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email
is strictly prohibited and appropriate legal action will be taken.
-------------------------------------------------------------------------------------------------------------------------------

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20141014/67541245/attachment.html>


More information about the mvapich-discuss mailing list