[mvapich-discuss]Infiniband - how do I know that it is working?

[Ju JiaJia]

I have run osu_latency and osu_bw with both mvapich2 and mpich2 on two
nodes, here is my test result

MVAPICH2(Infiniband）MPICH2（Ethernet）01.4515.1611.4915.2521.4915.1541.4915.15
81.515.17161.5315.17321.5716.4641.6616.881281.8317.82562.920.395123.1426.06
1K3.847.52K4.89193.974K5.99228.978K7.85233.1216K12.51241.3332K18.08432.3164K
28.7675.25128K50.021429.21256K92.572582.83512K177.654693.171M347.759110.472M
688.1217942.074M1373.935609.21

Here  is HPL results on two nodes:
HPL.out.ethernet.211:   WR00L2C2       20000   128     2     1            *
1686.40*              3.163e+00
HPL.out.ib.211:            WR00L2C2       20000   128     2     1
* 1639.99 *             3.252e+00

run script :
export MV2_ENABLE_AFFINITY=0
PATH=/gos4/user39/jujj/program-files/mvapich2/bin:$PATH

#
mpiexec -f mfile -n 2 taskset -c 0 ./xhpl > HPL.out.ib.211 2>&1
mpiexec -f mfile -n 2 taskset -c 0 ./xhpl_ethernet > HPL.out.ethernet.211
2>&1

As you can see, no big difference. I tested NAMD also, no big difference.
Is there any tools like netstat over infiniband ? So i can see whether
connections is built or which network is being used. Or MVAPICH2 support
some ways to do this? Log or something?

On Thu, May 31, 2012 at 11:43 AM, Dhabaleswar Panda <
panda at cse.ohio-state.edu> wrote:

> After installing MVAPICH2, you can run OSU MPI Micro-Benchmarks to verify
> that your installtion is correct. You can verify your performance with the
> performance numbers/graphs available at the MVAPICH site. After that you
> can carry out your applications-level study.
>
> DK
>
> On Thu, 31 May 2012, Ju JiaJia wrote:
>
> > Hi all:
> >
> > I am currently running HPL built using mvapich2 which use infiniband,
> > but it shows no apparently difference, compares in performance to a
> > build using mpich2 which uses Ethenet.
> >
> > There should be some improvement in performance. I doubt whether
> > infiniband is working. Anyone knows how to check whether infiniband is
> > working ?
> >
> >
> > Ju JiaJia
> >
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20120531/aab36417/attachment-0001.html