[MVAPICH-discuss] Install MVAPICH 1

[Stecher, Fred]

Jonathan,
The system administrator found another network monitor tool. I ran
osu_bw while watching the monitor. The Ethernet in and out traffic
peaked out at about 3000 counts/sec.  There was no InfiniBand traffic. I
need to run a test using the SGI mpirun package to make sure that the
InfiniBand is working.  I'll let you know.

Thanks,

Fred


-----Original Message-----
From: Jonathan Perkins [mailto:perkinjo at cse.ohio-state.edu] 
Sent: Monday, April 14, 2008 8:28 PM
To: Stecher, Fred
Subject: Re: [MVAPICH-discuss] Install MVAPICH 1

On Mon, Apr 14, 2008 at 04:07:29PM -0500, Stecher, Fred wrote:
> Jonathan,
> What I am saying is that when I monitor the network while my 
> application is running, no packets are being transferred over 
> InfiniBand, while Ethernet is busy. Maybe the SGI Clustervis monitor 
> software is not catching the InfiniBand traffic. It outputs every 2 
> seconds. Is there another interactive utility that I can use to 
> monitor the networks while my program is executing?

I'm not too familiar with those tools.  It'll be best to ask that
question on the discuss list.  However to find out if Clustervis monitor
is catching any IB traffic would be to see if it shows output while
running the OSU Benchmarks (such as osu_bw).

> 
> Thanks,
> 
> Fred
>  
> 
> -----Original Message-----
> From: Jonathan Perkins [mailto:perkinjo at cse.ohio-state.edu]
> Sent: Monday, April 14, 2008 3:35 PM
> To: Stecher, Fred
> Subject: Re: [MVAPICH-discuss] Install MVAPICH 1
> 
> On Mon, Apr 14, 2008 at 02:34:28PM -0500, Stecher, Fred wrote:
> > Jonathan,
> > You were right. The new build used the PGI compilers. I have rebuilt

> > the executable with the gen2 version of MVAPICH. I restarted my run 
> > and InfiniBand was not used. I then ran the osu_bw program with the 
> > following results:
> > # OSU MPI Bandwidth Test v3.0
> > # Size        Bandwidth (MB/s)
> > 1                         2.46
> > 2                         5.07
> > 4                         9.83
> > 8                        18.69
> > 16                       35.98
> > 32                       69.31
> > 64                      125.95
> > 128                     225.55
> > 256                     354.17
> > 512                     491.20
> > 1024                    615.13
> > 2048                    727.53
> > 4096                    795.82
> > 8192                    861.88
> > 16384                   858.40
> > 32768                   906.21
> > 65536                   931.13
> > 131072                  943.26
> > 262144                  949.19
> > 524288                  952.36
> > 1048576                 954.01
> > 2097152                 954.83
> > 4194304                 955.25
> > 
> > I have attached the log files.
> > 
> > Thanks,
> > 
> > Fred
> 
> I'm not quite sure what is being asked here.  The osu_bw numbers seem 
> to indicate that Infiniband is being used.  Are you saying that your 
> application is still not using Infiniband even after recompiling it or

> are you saying that it is now working?
> 
> --
> Jonathan Perkins
> http://www.cse.ohio-state.edu/~perkinjo

--
Jonathan Perkins
http://www.cse.ohio-state.edu/~perkinjo