[mvapich-discuss] Crash or wrong result with MPI_Win_flush from multiple threads

[Hoang-Vu Dang]

I attached the program. Please let me know if I'm doing the wrong semantic
or It's a bug with mvapich2, I'm using the one downloaded from the front
page (
http://mvapich.cse.ohio-state.edu/download/mvapich/mv2/mvapich2-2.0.tar.gz
).

The program spawns a number of threads, each performs a PUT with a same
amount of data from different offset of a memory address registered to a
window.

The program works correctly if MPI_Win_flush is removed. Please let me know
if I need to provide more information.

Thank you,
Vu

--------------------------------------------------------------------
It can be compiled using:

$ mpicxx -std=c++11 -O3 -Wall -I./include write_sync_mpi.cxx -o
write_sync_mpi

Run:

$ mpiexec -n 2 ./write_sync_mpi 1024 2
Testing MPI ... size 204800, threads 2
0 written something! Overall BW: 60.173350962 MB/s
1 received correct!

$ mpiexec -n 2 -ppn 1 ./write_sync_mpi 10240 2
Testing MPI ... size 2048000, threads 2
0 written something! Overall BW: 544.355106652 MB/s
1 received correct!

$ mpiexec -n 2 ./write_sync_mpi 102400 2
Testing MPI ... size 20480000, threads 2
0 written something! Overall BW: 1604.355574705 MB/s
Failed at 19558399

$ mpiexec -n 2 ./write_sync_mpi 102400 2
Testing MPI ... size 20480000, threads 2
[golubh4:mpi_rank_0][error_sighandler] Caught error: Segmentation fault
(signal 11)

$ gcc --version
gcc (GCC) 4.7.1

$ mpicc -v
mpicc for MVAPICH2 version 2.0
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/local/gcc-4.7.1/libexec/gcc/x86_64-unknown-linux-gnu/4.7.1/lto-wrapper
Target: x86_64-unknown-linux-gnu
Configured with: ../src/gcc-4.7.1/configure --with-gmp=/usr/local/gmp-5.0.5
--with-mpfr=/usr/local/mpfr-3.1.1 --with-mpc=/usr/local/mpc-1.0.1
--prefix=/usr/local/gcc-4.7.1
Thread model: posix
gcc version 4.7.1 (GCC)

$ mpichversion
MVAPICH2 Version:     2.0
MVAPICH2 Release date: Fri Jun 20 20:00:00 EDT 2014
MVAPICH2 Device:       ch3:mrail
MVAPICH2 configure:   --prefix=/home/hdang8/Softwares/mvapich2
MVAPICH2 CC:   gcc    -DNDEBUG -DNVALGRIND -O2
MVAPICH2 CXX: g++   -DNDEBUG -DNVALGRIND
MVAPICH2 F77: gfortran -L/lib -L/lib   -O2
MVAPICH2 FC:   gfortran
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20140915/75d933b3/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: write_sync_mpi.cxx
Type: text/x-c++src
Size: 2943 bytes
Desc: not available
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20140915/75d933b3/attachment-0001.bin>