[mvapich-discuss] thread safety over IB

[Krishna Kandalla]

Hi Andres,
        Great!. Please let us know if you have any other questions.

Regards,
Krishna

On Fri, Nov 4, 2011 at 1:24 PM, Marquez, Andres <andres.marquez at pnnl.gov>wrote:

> Krishna,****
>
> ** **
>
> thank you very much for your prompt response. ****
>
> So far, your suggestion seems to be working.****
>
> ** **
>
> ** **
>
> Thanks,****
>
> ** **
>
> -- Andrés****
>
> ** **
>
> *From:* krishna.kandalla at gmail.com [mailto:krishna.kandalla at gmail.com] *On
> Behalf Of *Krishna Kandalla
> *Sent:* Friday, November 04, 2011 7:30 AM
> *To:* Marquez, Andres
> *Cc:* mvapich-discuss at cse.ohio-state.edu
> *Subject:* Re: [mvapich-discuss] thread safety over IB****
>
> ** **
>
> Hello,
>          We do offer THREAD_MULTIPLE support for IB in MVAPICH2. Our
> default behavior is also consistent with MPICH2's "runtime" threading
> option -- the threading level is determined by the input parameters to
> MPI_Init_thread().
>          You do not have to use any additional configuration flags to turn
> on threading support in MV2-1.7. You just have to make sure you request for
> THREAD_MULTIPLE during Init. (Your sample code seems to be doing that
> already)  However, at job launch time, you may have to set
> processor-affinity to 0, using the MV2_ENABLE_AFFINITY=0 option. Please
> refer to section 6.14 in our userguide (
> http://mvapich.cse.ohio-state.edu/support/user_guide_mvapich2-1.7.html#x1-700006.14)
> for more information. Please let us know if you have any other questions.
>
> Thanks,
> Krishna
>        ****
>
> On Thu, Nov 3, 2011 at 7:49 PM, Marquez, Andres <andres.marquez at pnnl.gov>
> wrote:****
>
> All,****
>
>  ****
>
> we are trying to build the latest version of mvapich2-1.7  with following
> configuration (OFED stack is under /usr/lib64):****
>
>  ****
>
> configure --prefix=/home/d3m799/mvapich2-1.7/install --enable-shared
> --enable-threads=runtime  --enable-debuginfo --with-pm=none
> --with-pmi=slurm  2>&1 | tee c.txt****
>
>  ****
>
> Please find the configure, make and install logs attached.****
>
>  ****
>
> Running the following little program fails the assertion:****
>
> ----------------------------****
>
> #if HAVE_CONFIG_H****
>
> #   include "config.h"****
>
> #endif****
>
>  ****
>
> #include <mpi.h>****
>
> #include <assert.h>****
>
> #include <pthread.h>****
>
>  ****
>
> int main(int argc, char **argv)****
>
> {****
>
>   int provided;****
>
>   MPI_Init_thread(&argc, &argv, MPI_THREAD_MULTIPLE, &provided);****
>
>   assert(provided == MPI_THREAD_MULTIPLE);****
>
>  ****
>
>   MPI_Finalize();****
>
>   return 0;****
>
> }****
>
>  ****
>
> The latest mpich2-1.4.1p1 build over default ch3 succeeds with this
> program.****
>
>  ****
>
> The mvapcih2-1.7 README states:****
>
> quote****
>
> --enable-threads - Build MPICH2 with support for multi-threaded****
>
>                     applications. Only the sock and nemesis channels****
>
>                     support MPI_THREAD_MULTIPLE.****
>
> unquote****
>
>  ****
>
> My understanding was that MPI_THREAD_MULTIPLE over IB is supported?****
>
> Please advise.****
>
>  ****
>
> Thanks,****
>
>  ****
>
>  ****
>
>  ****
>
>  ****
>
>  ****
>
>  ****
>
>
> _______________________________________________
> mvapich-discuss mailing list
> mvapich-discuss at cse.ohio-state.edu
> http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss****
>
> ** **
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20111104/c6525c06/attachment.html