[mvapich-discuss] building mvapich2 on a large SMP

[Sankaran, Logan (Strategic Solutions Architecure (SSA))]

Hello Hari,

Thanks for your prompt response. I have asked our system admin to install OFED (it is not installed now).  I have two more questions to clarify:

1.      What is the largest no. of ranks one can run on a single server ?  Is there a maximum set in the source ?

2.      Will setting --with-device=ch3:sock during configuring help for a SMP build ?
Thanks and Regards,
Logan
From: hari.subramoni at gmail.com [mailto:hari.subramoni at gmail.com] On Behalf Of Hari Subramoni
Sent: Thursday, October 02, 2014 6:30 PM
To: Sankaran, Logan (Strategic Solutions Architecure (SSA))
Cc: mvapich-discuss at cse.ohio-state.edu
Subject: Re: [mvapich-discuss] building mvapich2 on a large SMP

Hi Dr. Sankaran,
The only requirement for building MVAPICH is that the system should have OFED libraries installed. As long as the OFED libraries are present, you should be able to compile and build MVAPICH2. Could you please install OFED libraries and retry? The following section of the userguide gives some more information about specific config options required if OFED libraries are in non standard locations

http://mvapich.cse.ohio-state.edu/static/media/mvapich/mvapich2-2.1a-userguide.html#x1-140004.6
To the best of our knowledge there should not be any other issues that will prevent you from running MVAPICH2 on this system. However, please note that we have not optimized MVAPICH2 for performance or memory footprint on such a large system before. So please let us know if you have any such issues and we will be glad to work with you.

Regards,
Hari.

On Thu, Oct 2, 2014 at 4:23 PM, Sankaran, Logan (Strategic Solutions Architecure (SSA)) <logan.sankaran at hp.com<mailto:logan.sankaran at hp.com>> wrote:
[cid:image001.gif at 01CFDE95.54A1B190]
Hello,

I am trying to build the latest version, 2.1a on a large SMP.  I am getting errors such as:
configure: error: 'libibverbs not found. Did you specify --with-ib-libpath=?'

Tried --without-ibverbs-lib and it doesn’t help.

Could you recommend configure options for a large SMP with 500 cores ?  Is there limit on the no. of ranks you can build and run on an SMP ?  How to increase this number ?
Thanks.
Logan
Logan Sankaran Ph.D.
HPC Strategist
Strategic Solutions Architecture (SSA)
Hewlett-Packard Company
Building/Floor/Post:    H4-GF-36
5400  Legacy Drive
PLANO, Texas 75024
USA

Ph:   972–605-5714<tel:972%E2%80%93605-5714>
 logan.sankaran at hp.com<mailto:logan.sankaran at hp.com>

Passion for Performance

Engage our services by:
Web:         http://engage.presales.hp.com<http://engage.presales.hp.com/> (select STS/Solution Center Team)
E-mail:         STS.central at hp.com<mailto:STS.central at hp.com>

HP and SSA – The Difference for Success

[email_footer_tree_text]



_______________________________________________
mvapich-discuss mailing list
mvapich-discuss at cse.ohio-state.edu<mailto:mvapich-discuss at cse.ohio-state.edu>
http://mailman.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20141003/c0b7688e/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.gif
Type: image/gif
Size: 2310 bytes
Desc: image001.gif
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20141003/c0b7688e/attachment-0002.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.gif
Type: image/gif
Size: 1814 bytes
Desc: image002.gif
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20141003/c0b7688e/attachment-0003.gif>