[mvapich-discuss] Any success stories for the mvapich2/intel pair for spack and/or easybuild?

[pramod kumbhar]

Sure!

We could discuss on spack list but here is brief summary : assuming verbs
already installed on the system, I specified following in packages.yaml:

    rdma-core:
        paths:
            rdma-core at 17.2: /usr
        version: [17.2]

Then installed mvapich2 as :

$ spack install mvapich2 at 2.3 process_managers=slurm fabrics=mrail
%intel at 18.0.1

This installed following packages :

$ spack spec -I mvapich2 at 2.3 process_managers=slurm fabrics=mrail
%intel at 18.0.1
Input spec
--------------------------------
     mvapich2 at 2.3%intel at 18.0.1 fabrics=mrail process_managers=slurm

Concretized
--------------------------------
[+]  mvapich2 at 2.3%intel at 18.0.1~alloca ch3_rank_bits=32 ~cuda~debug
fabrics=mrail file_systems= process_managers=slurm +regcache
threads=multiple arch=linux-rhel7-x86_64
[+]      ^bison at 3.0.4%intel at 18.0.1
patches=b72914fe38e54a6fc25f29019e0a0786705c4f61ce20d414cc2010c8d62448c7
arch=linux-rhel7-x86_64
[+]      ^libpciaccess at 0.13.5%intel at 18.0.1 arch=linux-rhel7-x86_64
[+]          ^libtool at 2.4.2%intel at 18.0.1 arch=linux-rhel7-x86_64
[+]          ^pkg-config at 0.27.1%intel at 18.0.1+internal_glib
patches=49ffcd644e190dc5efcb2fab491177811ea746c1a526f75d77118c2706574358
arch=linux-rhel7-x86_64
[+]          ^util-macros at 1.19.1%intel at 18.0.1 arch=linux-rhel7-x86_64
[+]      ^rdma-core at 17.2%intel at 18.0.1 build_type=RelWithDebInfo
arch=linux-rhel7-x86_64

Note that rdma-core has been recently added as dependency of mvapich2 (in
spack package) and doesn't build with intel compiler. If you don't add that
in packages.yaml as external, you can do following:

$ spack install mvapich2 at 2.3 process_managers=slurm fabrics=mrail
%intel at 18.0.1 ^rdma-core %gcc at 6.4.0

Hope this is helpful.

Regards,
Pramod





On Fri, Sep 14, 2018 at 10:49 PM Belgin, Mehmet <
mehmet.belgin at oit.gatech.edu> wrote:

> Hi Pramod,
>
> We’ve been partially successful installing intel+mvapich2 thanks to the
> support we received from the slack channel, but the software compilations
> using that combinations are failing consistently.
>
> We’d be grateful if you could share some of the configuration files. We’ll
> try to find you in Slack, then :)
>
> Thank you!!
>
> ---
> Mehmet Belgin, Ph.D.
> Research Facilitation Lead
> Partnership for an Advanced Computing Environment (PACE)
> Georgia Institute of Technology
> 258 4th Street NW, Rich Building, #326
> Atlanta, GA  30332-0700
> (404) 385-0665
>
> PACE team is growing!
> Interested in joining us? Check:
> http://pace.gatech.edu/careers
>
>
>
> On Sep 13, 2018, at 2:04 PM, pramod kumbhar <pramod.s.kumbhar at gmail.com>
> wrote:
>
> Dear Mehmet,
>
> We deploy large software stack with spack including mvapich2+intel
> compiler.
> I am not sure what you mean "..do not support this combination by
> default." (at least in spack context).
>
> If you have any specific questions or issues, I will be happy to help
> (here on mailing list or spack slack channel
> <https://spackpm.herokuapp.com/>).
>
> Regards,
> Pramod Kumbhar
>
>
> On Thu, Sep 13, 2018 at 7:32 PM Belgin, Mehmet <
> mehmet.belgin at oit.gatech.edu> wrote:
>
>> Greetings from Georgia Tech!
>>
>> We are considering Spack and Easybuild to build our new software
>> repository. We’ve had a lot of success with mvapich2 and intel compiler
>> combination in the past, but found out (surprisingly) that these tools do
>> not support this combination by default. They have good support for
>> GCC/OpenMPI and partially for gcc/mvapich2, but almost nothing for
>> intel/mvapich2. Our hacking efforts were also not too successful.
>>
>> We were hoping to get some pointers from the mvapich2 team and user
>> community, who might have been involved with spack/easybuild. I guess as a
>> very first question, is this combination even possible? Are there any
>> successful deployments out there?
>>
>> We’d really appreciate any insights/directions you may provide.
>>
>> Thank you!
>> -Mehmet (PACE Team, Georgia Tech)
>>
>>
>> ---
>> Mehmet Belgin, Ph.D.
>> Research Facilitation Lead
>> Partnership for an Advanced Computing Environment (PACE)
>> Georgia Institute of Technology
>> 258 4th Street NW, Rich Building, #326
>> Atlanta, GA  30332-0700
>> (404) 385-0665
>>
>> PACE team is growing!
>> Interested in joining us? Check:
>> http://pace.gatech.edu/careers
>>
>> _______________________________________________
>> mvapich-discuss mailing list
>> mvapich-discuss at cse.ohio-state.edu
>> http://mailman.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20180915/ddb63b42/attachment.html>