[mvapich-discuss]Infiniband - how do I know that it is working?

[Jonathan Perkins]

Sorry, I missed your latency and bw results.  The results show expected
results for each build.  You're using Infiniband with MVAPICH2 and
Ethernet with MPICH2.

If you're still unsure about the xhpl benchmarks and you built shared
libraries you can still use ldd to verify.

On Thu, May 31, 2012 at 08:50:45AM -0400, Jonathan Perkins wrote:
> Hello, can you try running the osu_latency test (the
> osu-micro-benchmarks also now contains collective benchmarks if you'd
> like to try those out)?  It may be easier to tell which network it is
> using that way.  You can also try 
> 
>     ldd /path/to/application
> 
> to make sure it is linked to the correct library (assuming you built
> with shared libraries).
> 
> What are the contents of mfile?
> 
> 
> On Thu, May 31, 2012 at 12:16:30PM +0800, Ju JiaJia wrote:
> > I have run osu_latency and osu_bw with both mvapich2 and mpich2 on two
> > nodes, here is my test result
> > 
> > MVAPICH2(Infiniband）MPICH2（Ethernet）01.4515.1611.4915.2521.4915.1541.4915.15
> > 81.515.17161.5315.17321.5716.4641.6616.881281.8317.82562.920.395123.1426.06
> > 1K3.847.52K4.89193.974K5.99228.978K7.85233.1216K12.51241.3332K18.08432.3164K
> > 28.7675.25128K50.021429.21256K92.572582.83512K177.654693.171M347.759110.472M
> > 688.1217942.074M1373.935609.21
> > 
> > Here  is HPL results on two nodes:
> > HPL.out.ethernet.211:   WR00L2C2       20000   128     2     1            *
> > 1686.40*              3.163e+00
> > HPL.out.ib.211:            WR00L2C2       20000   128     2     1
> > * 1639.99 *             3.252e+00
> > 
> > run script :
> > export MV2_ENABLE_AFFINITY=0
> > PATH=/gos4/user39/jujj/program-files/mvapich2/bin:$PATH
> > 
> > #
> > mpiexec -f mfile -n 2 taskset -c 0 ./xhpl > HPL.out.ib.211 2>&1
> > mpiexec -f mfile -n 2 taskset -c 0 ./xhpl_ethernet > HPL.out.ethernet.211
> > 2>&1
> > 
> > As you can see, no big difference. I tested NAMD also, no big difference.
> > Is there any tools like netstat over infiniband ? So i can see whether
> > connections is built or which network is being used. Or MVAPICH2 support
> > some ways to do this? Log or something?
> > 
> > On Thu, May 31, 2012 at 11:43 AM, Dhabaleswar Panda <
> > panda at cse.ohio-state.edu> wrote:
> > 
> > > After installing MVAPICH2, you can run OSU MPI Micro-Benchmarks to verify
> > > that your installtion is correct. You can verify your performance with the
> > > performance numbers/graphs available at the MVAPICH site. After that you
> > > can carry out your applications-level study.
> > >
> > > DK
> > >
> > > On Thu, 31 May 2012, Ju JiaJia wrote:
> > >
> > > > Hi all:
> > > >
> > > > I am currently running HPL built using mvapich2 which use infiniband,
> > > > but it shows no apparently difference, compares in performance to a
> > > > build using mpich2 which uses Ethenet.
> > > >
> > > > There should be some improvement in performance. I doubt whether
> > > > infiniband is working. Anyone knows how to check whether infiniband is
> > > > working ?
> > > >
> > > >
> > > > Ju JiaJia
> > > >
> > >
> > >
> 
> > _______________________________________________
> > mvapich-discuss mailing list
> > mvapich-discuss at cse.ohio-state.edu
> > http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
> 
> 
> -- 
> Jonathan Perkins
> http://www.cse.ohio-state.edu/~perkinjo
> 

-- 
Jonathan Perkins
http://www.cse.ohio-state.edu/~perkinjo