[mvapich-discuss] performance impact of ch3:mrail and ch3:nemesis:ib, tcp

[Jianyu Liu]

Hari,
 
Thank you for your kindly input
 
Just wanted to know how to specify the proper type for '--with-rdma' according to the installed IB interface / OFA-IB libs.
 
for example, 
 
InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] (rev b0)
 
CA 'mlx4_0'
        CA type: MT26428
        Number of ports: 1
        Firmware version: 2.9.1000
        Hardware version: b0
        Node GUID: 0x0002c90300532d00
        System image GUID: 0x0002c90300532d03
        Port 1:
                State: Active
                Physical state: LinkUp
                Rate: 40
                Base lid: 327
                LMC: 0
                SM lid: 2
                Capability mask: 0x0251086a
                Port GUID: 0x0002c90300532d01
                Link layer: InfiniBand

 
Jianyu
 
From: subramoni.1 at osu.edu
Date: Thu, 3 Apr 2014 06:24:20 -0700
Subject: Re: [mvapich-discuss] performance impact of ch3:mrail and ch3:nemesis:ib, tcp
To: jerry_leo at msn.com
CC: mvapich-discuss at cse.ohio-state.edu

Hello Jianyu,

Build #1 is the OpenFabrics (OFA) IB/iWARP/RoCE build for the CH3 channel in MVAPICH2. This is the default interface on Linux and has all the advanced performance and scalability features in MVAPICH2. Build #2 is the Nemesis sub-channel in MVAPICH2. It only has a subset of features that the CH3 channel has. We recommend that you use the CH3 channel for best performance and scalability at present.




I do not understand your second question. Could you please re-state it?

Regards,
Hari.


On Thu, Apr 3, 2014 at 2:49 AM, Jianyu Liu <jerry_leo at msn.com> wrote:





Hi,
 
There are two sorts of configurations for building for OFA-IB.  
 
Just wondering 
 
   1.  Any performance impact for these two sorts of builds?
 
             bld 1 ).   ./configure --with-device=ch3:mrail  --with-rdma=gen2


 
             bld 2 ).   ./configure --with-device=ch3:nemesis:ib,tcp 
 
  2. How to find the proper rdma type?
 
Appreciating your kindly help
 
Jianyu




 		 	   		  

_______________________________________________

mvapich-discuss mailing list

mvapich-discuss at cse.ohio-state.edu

http://mailman.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss



 		 	   		  
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20140403/e51900a0/attachment.html>