[mvapich-discuss] mvapich2 1.9 and pgi 13.10: compilation problem

[Jonathan Perkins]

Thanks for providing the logs.  Based on a hunch and what I see in the
make log, I think there is a libtool file (ex. libfoo.la) that may be
telling libtool to add the -pthread option unconditionally even though
the PGI compiler does not recognize this.  Can you share whether
/apps/pilatus/slurm/2.5.4-pam/lib/libpmi.la exists and if it does the
content of it?

It looks like ``-lpmi'' may have expanded to
``/apps/pilatus/slurm/2.5.4-pam/lib/libpmi.so
/apps/pilatus/slurm/2.5.4-pam/lib/libslurm.so
/apps/pilatus/slurm/hwloc/lib/libhwloc.so -lnuma /usr/lib64/libxml2.so
-ldl -lz -lm'' with various CFLAGS and LDFLAGS appended to the end.  I
think this may be where -pthread is coming from.

If this is the case.  You'll most likely need to edit the .la file (or
one of the .la files of the additional libraries) to avoid adding
-pthread.  I'll be able to tell more after your reply.

On Thu, Jan 23, 2014 at 5:39 AM, Carmelo Ponti (CSCS) <cponti at cscs.ch> wrote:
> Dear Jonathan
>
> thank you for your prompt reply.
>
> I created a build with the following options:
>
> ./configure CC=pgcc CXX=pgCC FC=pgf90 F77=pgf77 --with-pmi=slurm
> --with-pm=mpirun -with-slurm=/apps/pilatus/slurm/default
>
> And attached you can find the output of 'make V=1 > make.log 2>& 1' and
> the config.log
>
> regards
> Carmelo
>
> On Wed, 2014-01-22 at 14:44 -0500, Jonathan Perkins wrote:
>> Hello.  Thanks for the note.  I tried to reproduce this issue but
>> wasn't able to.  I believe it may be easier to debug your issue if you
>> create a build with the minimal options necessary to reproduce your
>> issue and use `make V=1' so that we can see the command that emits the
>> error.  Thanks in advance!
>>
>> On Wed, Jan 22, 2014 at 11:10 AM, Carmelo Ponti (CSCS) <cponti at cscs.ch> wrote:
>> > Hello
>> >
>> > I'm trying to compile mvapich2 1.9 with pgi 13.10 but I'm getting the
>> > following error:
>> >
>> >   CC       src/mpi_t/pvar_write.lo
>> >   CC       src/binding/f77/setbot.lo
>> >   F77      src/binding/f77/setbotf.lo
>> >   CC       src/mpi/debugger/src_mpi_debugger_libdbginitdummy_la-dbginit.lo
>> >   CCLD     src/mpi/debugger/libdbginitdummy.la
>> >   CC       src/mpid/ch3/channels/common/src/affinity/hwloc_bind.lo
>> >   CCLD     libch3affinity.la
>> >   GEN      lib/libmpich.la
>> > pgf77-Error-Unknown switch: -pthread
>> > make[2]: *** [lib/libmpich.la] Error 1
>> > make[2]: Leaving directory `/apps/pilatus/system/src/MVAPICH2/mvapich2-1.9/mvapich2-1.9-pgi'
>> > make[1]: *** [all-recursive] Error 1
>> > make[1]: Leaving directory `/apps/pilatus/system/src/MVAPICH2/mvapich2-1.9/mvapich2-1.9-pgi'
>> > make: *** [all] Error 2
>> >
>> > I find out that the problem is caused by the following configuration
>> > options:
>> >
>> > --with-pmi=slurm --with-pm=mpirun
>> >
>> > I don't get any compilation problem doing the same with gcc 4.8.2 or
>> > with intel 14.0.1.
>> >
>> > Following some more detail about my environment:
>> >
>> > OS: SUSE SLES 11 SP3
>> > OFED: 3.5.2
>> >
>> > Configuration:
>> >
>> > ./configure --prefix=/apps/mvapich2/1.9/pgi-13.10 \
>> > --enable-threads=default --enable-shared --enable-sharedlibs=gcc \
>> > --enable-fc --with-mpe --enable-rsh --enable-rdma-cm --enable-fast \
>> > --enable-smpcoll --with-hwloc --with-device=ch3:mrail --with-rdma=gen2 \
>> > --enable-g=dbg --enable-debuginfo --with-limic2 CC=pgcc CXX=pgCC \
>> > FC=pgf90 F77=pgf77 --with-slurm=/apps/slurm/default \ --with-pmi=slurm
>> > --with-pm=mpirun \ CPPFLAGS=-I/apps/slurm/default/include \
>> > LDFLAGS=-L/apps/slurm/default/lib
>> >
>> > Please let me know if you need more information.
>> >
>> > Thank you in advance for your help
>> > Carmelo Ponti
>> > --
>> > ----------------------------------------------------------------------
>> > Carmelo Ponti           System Engineer
>> > CSCS                    Swiss Center for Scientific Computing
>> > Via Trevano 131         Email: cponti at cscs.ch
>> > CH-6900 Lugano          http://www.cscs.ch
>> >                         Phone: +41 91 610 82 15/Fax: +41 91 610 82 82
>> > ----------------------------------------------------------------------
>> >
>> >
>> > _______________________________________________
>> > mvapich-discuss mailing list
>> > mvapich-discuss at cse.ohio-state.edu
>> > http://mailman.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
>> >
>> >
>>
>>
>>
>
> --
> ----------------------------------------------------------------------
> Carmelo Ponti           System Engineer
> CSCS                    Swiss Center for Scientific Computing
> Via Trevano 131         Email: cponti at cscs.ch
> CH-6900 Lugano          http://www.cscs.ch
>                         Phone: +41 91 610 82 15/Fax: +41 91 610 82 82
> ----------------------------------------------------------------------



-- 
Jonathan Perkins
http://www.cse.ohio-state.edu/~perkinjo