[mvapich-discuss] ucx + mvapich2

[Panda, Dhabaleswar]

Hi,

Thanks for your question. To use MVAPICH2 libraries with best performance and scalability, there is no need to use UCX or OFA verbs. The MVAPICH2 libraries directly use Verbs and the associated features.

If you are looking for the best library for your GPU cluster, please use the MVAPICH2-GDR library (not the basic MVAPICH2). The
MVAPICH2-GDR library has many more features for exploiting performance and scalability on GPU clusters.

For non-GPU clusters, we strongly recommend to use the MVAPICH2-X version. This supports many advanced InfiniBand features such as Hybrid RC/UD, Direct Connect Transprt, (DC), Core-direct, ODP, UMR, advanced collectives, etc.

Please visit the MVAPICH page to download the appropriate version of the library for your cluster and use the associated user guide to install and use it.

Let us know if you have any additional questions.

Thanks,

DK
________________________________
From: mvapich-discuss-bounces at cse.ohio-state.edu on behalf of Morin, Monique Marlene [morin at lanl.gov]
Sent: Thursday, June 07, 2018 8:31 PM
To: mvapich-discuss at cse.ohio-state.edu
Subject: [mvapich-discuss] ucx + mvapich2

Hello,


We are considering installing/using "UCX" on a cluster with GPUs.  The machine has mvapich2 (version 2.2) already installed.


Our initial testing shows that executables compiled WITHOUT UCX appear to function fine WITH UCX at a very small scale.  Thus it appears no rebuilding of mvapich2 and/or recompiling of source code will be needed.


How does mvapich2 deal with layers such as OFA verbs and/or UCX?  Does it use them or does it have its own custom interface/framework?


Would mvapich2 (and codes built with it) experience better performance if it were built with a UCX specific configuration, is there such a configuration for building mvapich2?


Thanks!
-------------- next part --------------
A non-text attachment was scrubbed...
Name: winmail.dat
Type: application/ms-tnef
Size: 8895 bytes
Desc: not available
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20180608/7e189271/attachment-0001.bin>