[mvapich-discuss] mvapich2/2.2 optimization for Intel omni-path?

[Jung]

We recently acquired a KNL system with dual Omni-path and are trying to 
find a way to saturate network bandwidth. Usual, although somewhat 
suboptimal, stragegy of using multiple MPI per node doesn't seem to work, 
as the intranode bandwidth is only similar to inter-node bandwith for 
MPI_Isend and receive.

MVAPICH2 2.2 feature list inculdes optimized inter- and intra-node 
communication for KNL. Can someone comment on the performance of Omni-path 
with KNL and/or pointers for optimizing them?

Best,

Chulwoo Jung
Physics Department
Brookhaven National Laboratory
U.S.A.
chulwoo at bnl.gov
1-631-344-5254