[mvapich-discuss] MVAPICh2 1.9 & PGI 14.3, "nvlink fatal : Unsupported file type"

[Jonathan Perkins]

Hello Filippo, you may want to try rebuilding with less or default
options to see if you can reproduce this.  I also want to note that
you're attempting to use knem with the gen2 interface of mvapich2 but
this is not supported.  You may want to replace this with an option to
enable cma or limic2 support.  Please see the following urls to our
userguide for more information.

Building with LiMIC2 or CMA
http://mvapich.cse.ohio-state.edu/support/user_guide_mvapich2-1.9.html#x1-110004.4

Building LiMIC2
http://mvapich.cse.ohio-state.edu/support/user_guide_mvapich2-1.9.html#x1-590006.6

If the issue persists may also want to try mvapich2-2.0rc1.  Let me
know if any of this helps.

On Fri, Apr 11, 2014 at 10:24 AM, Filippo Spiga <spiga.filippo at gmail.com> wrote:
> Dear MVAPICH2 developers,
>
> I am investigating an issue related to a GPU code on my cluster and to make
> my environment as much comparable as another system (where the code works
> perfectly) I decided to compile MVAPICH2 1.9 with PGI 14.3. This is just a
> test and if I cannot carry this over this step then I will continue testing
> using MVAPICH2 2.0b. Just a note, GPU-awareness is not required for this
> code (it is OpenACC based)
>
> This is how I run the configure:
>
> export KNEM_DIR=$(find /opt -maxdepth 1 -type d -name "knem*" -print0)
>
> ./configure CC=pgcc CXX=pgCC FC=pgf90 CFLAGS="-fast -m64 -noswitcherror"
> FCFLAGS="-m64 -fast -noswitcherror" CXXFLAGS="-m64 -fast -noswitcherror"
> LDFLAGS="-L/usr/lib64" MPICHLIB_LDFLAGS="-L/usr/lib64"
> --prefix=/usr/local/Cluster-Users/fs395/mvapich2-1.9/pgi-14.3
> --with-device=ch3:mrail --with-rdma=gen2 --enable-rdma-cm --disable-blcr
> --enable-threads=default --enable-shared --enable-sharedlibs=gcc
> --enable-cxx --enable-fc --enable-f77 --enable-g=none --enable-fast
> --with-knem=${KNEM_DIR} --with-knem-include=${KNEM_DIR}/include
> --enable-romio --without-cuda
>
>
> and this the error I get during make
>
>   CCLD     osu_alltoallv
> nvlink fatal   : Unsupported file type '../lib/.libs/libmpich.so'
> pgacclnk: child process exit status 2:
> /usr/local/Cluster-Apps/pgi/linux86-64/14.3/bin/pgnvd
> make[2]: *** [osu_alltoallv] Error 2
> make[2]: Leaving directory `/home/fs395/archive/mvapich2-1.9/osu_benchmarks'
> make[1]: *** [all-recursive] Error 1
> make[1]: Leaving directory `/home/fs395/archive/mvapich2-1.9'
> make: *** [all] Error 2
>
>
> Apparently "make install" works. I am compiling the GPU code now.
>
> Only OSU suite is not compiled due to the message above. I wonder where the
> problem I see is coming from. Any clue?
>
> Regards,
> Filippo
>
> --
> Mr. Filippo SPIGA, M.Sc.
> http://www.linkedin.com/in/filippospiga ~ skype: filippo.spiga
>
> «Nobody will drive us out of Cantor's paradise.» ~ David Hilbert
>
> *****
> Disclaimer: "Please note this message and any attachments are CONFIDENTIAL
> and may be privileged or otherwise protected from disclosure. The contents
> are not to be disclosed to anyone other than the addressee. Unauthorized
> recipients are requested to preserve this confidentiality and to advise the
> sender immediately of any error in transmission."
>
>
>
> _______________________________________________
> mvapich-discuss mailing list
> mvapich-discuss at cse.ohio-state.edu
> http://mailman.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
>



-- 
Jonathan Perkins
http://www.cse.ohio-state.edu/~perkinjo