[mvapich-discuss] performance impact of ch3:mrail and ch3:nemesis:ib, tcp

[Hari Subramoni]

Hello Jianyu,

You do not need this configure parameter. MVAPICH2 can identify and handle
these IB HCAs at runtime automatically.

Please refer to the following section of the userguide for more information
about how to configure MVAPICH2 for the CH3 (default) channel.

http://mvapich.cse.ohio-state.edu/support/user_guide_mvapich2-2.0rc1.html#x1-110004.4

The following link has some information about running MVAPICH2.

http://mvapich.cse.ohio-state.edu/support/user_guide_mvapich2-2.0rc1.html#x1-240005.2.1

I hope this clarifies the situation.

Regards,
Hari.


On Thu, Apr 3, 2014 at 8:10 AM, Jianyu Liu <jerry_leo at msn.com> wrote:

> Hari,
>
> Thank you for your kindly input
>
> Just wanted to know how to specify the proper type for '--with-rdma'
> according to the installed IB interface / OFA-IB libs.
>
> for example,
>
> InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s -
> IB QDR / 10GigE] (rev b0)
>
> CA 'mlx4_0'
>         CA type: MT26428
>         Number of ports: 1
>         Firmware version: 2.9.1000
>         Hardware version: b0
>         Node GUID: 0x0002c90300532d00
>         System image GUID: 0x0002c90300532d03
>         Port 1:
>                 State: Active
>                 Physical state: LinkUp
>                 Rate: 40
>                 Base lid: 327
>                 LMC: 0
>                 SM lid: 2
>                 Capability mask: 0x0251086a
>                 Port GUID: 0x0002c90300532d01
>                 Link layer: InfiniBand
>
>
> Jianyu
>
> ------------------------------
> From: subramoni.1 at osu.edu
> Date: Thu, 3 Apr 2014 06:24:20 -0700
> Subject: Re: [mvapich-discuss] performance impact of ch3:mrail and
> ch3:nemesis:ib, tcp
> To: jerry_leo at msn.com
> CC: mvapich-discuss at cse.ohio-state.edu
>
>
> Hello Jianyu,
>
> Build #1 is the OpenFabrics (OFA) IB/iWARP/RoCE build for the CH3 channel
> in MVAPICH2. This is the default interface on Linux and has all the
> advanced performance and scalability features in MVAPICH2. Build #2 is the
> Nemesis sub-channel in MVAPICH2. It only has a subset of features that the
> CH3 channel has. We recommend that you use the CH3 channel for best
> performance and scalability at present.
>
> I do not understand your second question. Could you please re-state it?
>
> Regards,
> Hari.
>
>
> On Thu, Apr 3, 2014 at 2:49 AM, Jianyu Liu <jerry_leo at msn.com> wrote:
>
> Hi,
>
> There are two sorts of configurations for building for OFA-IB.
>
> Just wondering
>
>    1.  Any performance impact for these two sorts of builds?
>
>              bld 1 ).   ./configure --with-device=ch3:mrail
> --with-rdma=gen2
>
>              bld 2 ).   ./configure --with-device=ch3:nemesis:ib,tcp
>
>   2. How to find the proper rdma type?
>
> Appreciating your kindly help
>
> Jianyu
>
>
>
> _______________________________________________
> mvapich-discuss mailing list
> mvapich-discuss at cse.ohio-state.edu
> http://mailman.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
>
>
>
> _______________________________________________
> mvapich-discuss mailing list
> mvapich-discuss at cse.ohio-state.edu
> http://mailman.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20140403/521b4a44/attachment-0001.html>