[mvapich-discuss] IB driver not detected by MVAPICH on NERSC Carver machine

Sayantan Sur surs at cse.ohio-state.edu
Mon Jun 7 12:31:06 EDT 2010


Hi Jeff,

On Mon, Jun 7, 2010 at 11:42 AM, Jeff Hammond <jhammond at mcs.anl.gov> wrote:
> Are there any performance penalties associated with this?  I'm not
> going to ask NERSC to install librdmacm unless it matters.  If it's
> not critical to have that library, why not make configure tolerate its
> absence?
>

I do not think there are any performance penalties. RDMA CM is
required only when you are using iWARP (it works with IB as well). Our
aim was to unify the build with iWARP, so that users can just use
environment variables to turn it on.

In any case, your suggestion is good that we can turn it off by
ourselves if it is not found. We will do it in a future release.

Thanks.

> Jeff
>
> On Mon, Jun 7, 2010 at 7:34 AM, Jonathan Perkins
> <perkinjo at cse.ohio-state.edu> wrote:
>> It doesn't look like librdmacm is installed.  You'll either need to
>> have this installed properly or pass the --disable-rdma-cm option when
>> configuring mvapich2.  Hope this helps.
>>
>> On Sun, Jun 6, 2010 at 4:55 PM, Jeff Hammond <jhammond at mcs.anl.gov> wrote:
>>> The Carver machine at NERSC
>>> (http://www.nersc.gov/nusers/systems/carver/config/) is almost
>>> identical to the Fusion cluster at Argonne.  However, this machine
>>> does not have /usr/lib64/librdmacm.so (or at least it is in the wrong
>>> place), hence I cannot build MVAPICH2 (mvapich2-1.5rc1).  The closest
>>> thing I can find is  /usr/lib64/libmlx4-rdmav2.so but I have no idea
>>> if that is an equivalent library.
>>>
>>> I attached the config.log from my first attempt.  Please ignore that
>>> the prefix does not line up properly with the compilers that were
>>> actually used.
>>>
>>> Best,
>>>
>>> Jeff
>>>
>>> --
>>> Jeff Hammond
>>> Argonne Leadership Computing Facility
>>> jhammond at mcs.anl.gov / (630) 252-5381
>>> http://www.linkedin.com/in/jeffhammond
>>>
>>> _______________________________________________
>>> mvapich-discuss mailing list
>>> mvapich-discuss at cse.ohio-state.edu
>>> http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
>>>
>>>
>>
>>
>>
>> --
>> Jonathan Perkins
>>
>
>
>
> --
> Jeff Hammond
> Argonne Leadership Computing Facility
> jhammond at mcs.anl.gov / (630) 252-5381
> http://www.linkedin.com/in/jeffhammond
>
> _______________________________________________
> mvapich-discuss mailing list
> mvapich-discuss at cse.ohio-state.edu
> http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
>
>



-- 
Sayantan Sur

Research Scientist
Department of Computer Science
The Ohio State University.



More information about the mvapich-discuss mailing list