[mvapich-discuss] MVAPICH2-2.0.1 with Limic2 and PSM

[Hari Subramoni]

Hello Razen,

MVAPICH2 completely relies on the PSM layer for both intra-node and
inter-node communication. So there is no MVAPICH2 level support for CMA
when it is configured to run for the PSM channel.

However, the PSM layer has support for Linux Cross Memory Attach (CMA)
based intra-node communication which is enabled based on the message size
inside the PSM layer. You should be able to utilize this capability which
is similar to LiMIC/KNEM. This is enabled by default.

Please let us know if you have any other questions.

Regards,
Hari.

On Sun, Aug 13, 2017 at 8:49 AM, Razen Al Harbi <razen.alharbi at gmail.com>
wrote:

> Greetings MVAPICH team,
>
> We've been trying to evaluate MVAPICH2-2.0.1 with Limic2 option enabled.
> We are using infiniband (Qlogic PSM) interconnect. The problem we're facing
> is that mvapich does not use limic2 when configured using ch3:psm. The same
> thing applies to KNEM. Our goal is to use limic/knem for intra-node while
> using psm for inter-node communication.
>
> So, the question is does mvapich2 work with such a configuration? And if
> yes, how?
>
> Regards,
>
> Razen
>
> _______________________________________________
> mvapich-discuss mailing list
> mvapich-discuss at cse.ohio-state.edu
> http://mailman.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20170813/97625e4a/attachment.html>