[mvapich-discuss] Missing infiniband/ib.h when installing

[Subramoni, Hari]

Hi, Rich.

It turns out the header file is needed for a feature after all. Although, it may not be needed for you, the following is the correct patch and should still work for your case. I'm just sending to ensure that the community is aware of the correct patch. This will be available in the next MVAPICH2 release.

diff --git a/src/mpid/ch3/channels/common/include/rdma_cm.h b/src/mpid/ch3/channels/common/include/rdma_cm.h
index 9dd76f4..ac8f32a 100644
--- a/src/mpid/ch3/channels/common/include/rdma_cm.h
+++ b/src/mpid/ch3/channels/common/include/rdma_cm.h
@@ -26,6 +26,9 @@
 #include <pthread.h>
 #include <rdma/rdma_cma.h>
 #include <infiniband/verbs.h>
+#ifdef _MULTI_SUBNET_SUPPORT_
+#include <infiniband/ib.h>
+#endif /*_MULTI_SUBNET_SUPPORT_*/
 #include "rdma_impl.h"

 extern int g_num_smp_peers;

Thx,
Hari.

-----Original Message-----
From: mvapich-discuss-bounces at cse.ohio-state.edu On Behalf Of RICHARD H D TOWNSEND
Sent: Tuesday, January 23, 2018 8:19 PM
To: Subramoni, Hari <subramoni.1 at osu.edu>
Cc: mvapich-discuss at cse.ohio-state.edu <mvapich-discuss at mailman.cse.ohio-state.edu>
Subject: Re: [mvapich-discuss] Missing infiniband/ib.h when installing

Hi Hari --

Your patch did the trick -- many thanks!

Rich

> On Jan 23, 2018, at 10:27 AM, Subramoni, Hari <subramoni.1 at osu.edu> wrote:
> 
> Hi, Rich.
> 
> Actually, that header file is not needed for RDMA_CM to work. I guess it was just a some old code that was just not deleted. You should be able to build without the configuration flag I mentioned after applying this patch. This will be available with the next release of MVAPICH2 as well.
> 
> diff --git a/src/mpid/ch3/channels/common/include/rdma_cm.h b/src/mpid/ch3/channels/common/include/rdma_cm.h
> index b5cc5b4..9dd76f4 100644
> --- a/src/mpid/ch3/channels/common/include/rdma_cm.h
> +++ b/src/mpid/ch3/channels/common/include/rdma_cm.h
> @@ -26,7 +26,6 @@
> #include <pthread.h>
> #include <rdma/rdma_cma.h>
> #include <infiniband/verbs.h>
> -#include <infiniband/ib.h>
> #include "rdma_impl.h"
> 
> extern int g_num_smp_peers;
> 
> Thx,
> Hari.
> 
> -----Original Message-----
> From: mvapich-discuss-bounces at cse.ohio-state.edu On Behalf Of RICHARD H D TOWNSEND
> Sent: Tuesday, January 23, 2018 4:04 PM
> To: Subramoni, Hari <subramoni.1 at osu.edu>
> Cc: mvapich-discuss at cse.ohio-state.edu <mvapich-discuss at mailman.cse.ohio-state.edu>
> Subject: Re: [mvapich-discuss] Missing infiniband/ib.h when installing
> 
> Hi Hari --
> 
> Thanks for the suggestion -- that indeed works around the problem, and MVAPICH2 now compiles without problem (haven't tested yet, though).
> 
> What exactly have I disabled with '--disable-rdma-cm'? Also, does anyone have any suggestions regarding which RPM might contain ib.h for OpenSuse?
> 
> cheers,
> 
> Rich
> 
>> On Jan 23, 2018, at 8:51 AM, Subramoni, Hari <subramoni.1 at osu.edu> wrote:
>> 
>> Hello.
>> 
>> It looks like all components may not have been installed during your OFED installation. Can you please re-configure MVAPICH2 after adding --disable-rdma-cm and see if you're able to get around this error?
>> 
>> Thx,
>> Hari.
>> 
>> -----Original Message-----
>> From: mvapich-discuss-bounces at cse.ohio-state.edu On Behalf Of RICHARD H D TOWNSEND
>> Sent: Tuesday, January 23, 2018 3:45 PM
>> To: mvapich-discuss at cse.ohio-state.edu <mvapich-discuss at mailman.cse.ohio-state.edu>
>> Subject: [mvapich-discuss] Missing infiniband/ib.h when installing
>> 
>> Hi folks --
>> 
>> I'm attempting to compile and install mvapich2-2.3b on a rather old Linux cluster (OpenSuse 11; Linux 2.6.25). When I configure using
>> 
>> ./configure --build=x86_64-pc-linux-gnu --prefix=/home/townsend/madsdk --with-device=ch3:mrail --disable-shared
>> 
>> and then run
>> 
>> make -j8,
>> 
>> the compilation proceeds smoothly for some time before crashing with the following error:
>> 
>> CC       src/mpid/ch3/channels/common/src/reg_cache/lib_libmpi_la-dreg.lo
>> In file included from src/mpid/ch3/channels/mrail/src/gen2/rdma_iba_init.c:27:0:
>> /home/townsend/devel/madsdk-src/mvapich/src/mpid/ch3/channels/common/include/rdma_cm.h:29:10: fatal error: infiniband/ib.h: No such file or directory  #include <infiniband/ib.h>
>>         ^~~~~~~~~~~~~~~~~
>> compilation terminated.
>> make[2]: *** [src/mpid/ch3/channels/mrail/src/gen2/lib_libmpi_la-rdma_iba_init.lo] Error 1
>> make[2]: *** Waiting for unfinished jobs....
>> In file included from src/mpid/ch3/channels/mrail/src/gen2/rdma_iba_priv.c:18:0:
>> /home/townsend/devel/madsdk-src/mvapich/src/mpid/ch3/channels/common/include/rdma_cm.h:29:10: fatal error: infiniband/ib.h: No such file or directory  #include <infiniband/ib.h>
>>         ^~~~~~~~~~~~~~~~~
>> compilation terminated.
>> make[2]: *** [src/mpid/ch3/channels/mrail/src/gen2/lib_libmpi_la-rdma_iba_priv.lo] Error 1
>> 
>> I've checked in /usr/include/infiniband, and there's no ib.h header. But I don't know where to get it from.
>> 
>> cheers,
>> 
>> Rich
>> 
>> 
>> _______________________________________________
>> mvapich-discuss mailing list
>> mvapich-discuss at cse.ohio-state.edu
>> http://mailman.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
> 
> 
> _______________________________________________
> mvapich-discuss mailing list
> mvapich-discuss at cse.ohio-state.edu
> http://mailman.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss


_______________________________________________
mvapich-discuss mailing list
mvapich-discuss at cse.ohio-state.edu
http://mailman.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
-------------- next part --------------
A non-text attachment was scrubbed...
Name: winmail.dat
Type: application/ms-tnef
Size: 6152 bytes
Desc: not available
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20180123/930ddb0d/attachment-0001.bin>