[mvapich-discuss] mvapich: using IPoIB or direct IB?

Peter Kjellstrom cap at nsc.liu.se
Thu Jul 12 03:29:08 EDT 2007


On Wednesday 11 July 2007, Michael Zebrowski wrote:
> Does anyone know a good way to determine whether mvapich is utilizing
> IPoIB or direct IB during its run?

two out-of-band sanity checks:

1) If the counters on ib0 (ifconfig ib0) doesn't tick up then you're running 
over verbs.
2) if the latency you see is <10 us then you're running over verbs

> I have validated that the packet 
> counters increase significantly (using OFED's perfquery) on nodes that
> are referenced during the mpi run (and do not increase when they are not
> referenced), but I wanted to confirm that this is an accurate approach
> in determining this.

It is not, perfquery will show both verbs and IPoIB traffic, it will show all 
IB traffic afaik.

/Peter
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part.
Url : http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20070712/65ad9df4/attachment.bin


More information about the mvapich-discuss mailing list