[mvapich-discuss] mpi_probe hangs on PSM

[Low, John J.]

To Whom It May Concern:

I have noticed that MPI_PROBE hangs on the LCRC cluster blues (https://www.lcrc.anl.gov/systems/resources/blues/) with mvapich2 and openmpi but not mpich for a few applications like parallel-HDF5 and the attached example.

The attached example hangs when linked with mvapich2-v2.2 and openmpi-2.0.2 and not mpich-3.2 on blues.  Blues is a sandybridge cluster connected with PSM/InfiniPath. All of these libraries were compiled with intel-17.0.2.

The example ran fine on the JLSE (http://www.jlse.anl.gov/) login node linked with intel-mpi, which are sandybridge nodes connected by Mellanox Infiniband.

I suspect there is an issue with the PSM interface and MPI_PROBE, because the test runs fine when not using the PSM interface.

Could someone explain what is happening in this case and if there is patch or workaround for this issue?

John J. Low
Principal Computational Science Specialist
Computing, Environment and Life Sciences
Building 240, 2143
9700 South Cass Avenue
Argonne National Laboratory
Argonne, IL 60439.
630-252-0045
www.linkedin.com/pub/john-low/15/8b0/5aa/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20170323/ea6ddaa4/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: do_test_probe
Type: application/octet-stream
Size: 228 bytes
Desc: do_test_probe
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20170323/ea6ddaa4/attachment.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: make_test_probe
Type: application/octet-stream
Size: 71 bytes
Desc: make_test_probe
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20170323/ea6ddaa4/attachment-0001.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: test_probe.f
Type: application/octet-stream
Size: 1522 bytes
Desc: test_probe.f
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20170323/ea6ddaa4/attachment-0002.obj>