[Mvapich-discuss] Mvapich4 and rocky linux 9.5 (RHEL9.5)

Tue Apr 8 13:52:23 EDT 2025

Hi Blaise,

Not sure how exactly you are configuring your environment, but it looks like you are actually building OpenMPI, not MVAPICH in your source build. In that case, you are having the same error with both MVAPICH and OMPI, which suggests that this is a system error or an issue with your AOCC installation. If these libraries are in your runtime paths, they may also be impacting the RPM installation. In addition, the RPM you have is built with GCC 13 compilers, not AOCC so you will want to make sure you have the same compiler installed.

Thanks,
Nat
________________________________
From: Mvapich-discuss <mvapich-discuss-bounces+shineman.5=osu.edu at lists.osu.edu> on behalf of Blaise Bourdin via Mvapich-discuss <mvapich-discuss at lists.osu.edu>
Sent: Tuesday, April 8, 2025 10:34
To: mvapich-discuss at lists.osu.edu <mvapich-discuss at lists.osu.edu>
Subject: [Mvapich-discuss] Mvapich4 and rocky linux 9.5 (RHEL9.5)

!-------------------------------------------------------------------|
  This Message Is From an External Sender
  This message came from outside your organization.
|-------------------------------------------------------------------!

Hi,

I am running into the same problem when building the tarball for MVAPICH 4.0 at https://mvapich.cse.ohio-state.edu/download/mvapich/mv2/mvapich-4.0.tar.gz   with the AMD AOCC compilers v5.0 and trying to use the RPM distribution of MVAPICH-Plus 4.0:

When building MVAPICH 4.0, I get the following error message:
./configure --prefix=/2/sw/HPC/openmpi/5.0.7 CC=clang FC=flang CXX=clang++ --with-slurm

libtool: link: clang -DOPAL_CONFIGURE_USER=\"bourdinb\" -DOPAL_CONFIGURE_HOST=\"bbserv\" "-DOPAL_CONFIGURE_DATE=\"Mon Apr  7 14:42:59 UTC 2025\"" -DOMPI_BUILD_USER=\"bourdinb\" -DOMPI_BUILD_HOST=\"bbserv\" "-DOMPI_BUILD_DATE=\"Mon Apr  7 02:58:17 PM UTC 2025\"" "-DOMPI_BUILD_CFLAGS=\"-O3 -DNDEBUG  -finline-functions -mcx16\"" "-DOMPI_BUILD_CPPFLAGS=\"-iquote../../..  -I/2/sw/HPC/src/openmpi-5.0.7/3rd-party/libevent-2.1.12-stable-ompi -I/2/sw/HPC/src/openmpi-5.0.7/3rd-party/libevent-2.1.12-stable-ompi/include -I/2/sw/HPC/src/openmpi-5.0.7/3rd-party/hwloc-2.7.1/include -I/2/sw/HPC/src/openmpi-5.0.7/3rd-party/hwloc-2.7.1/include -I/2/sw/HPC/src/openmpi-5.0.7/3rd-party/openpmix/include -I/2/sw/HPC/src/openmpi-5.0.7/3rd-party/openpmix/include -I/2/sw/HPC/src/openmpi-5.0.7/3rd-party/openpmix/ -I/2/sw/HPC/src/openmpi-5.0.7/3rd-party/openpmix/\"" "-DOMPI_BUILD_CXXFLAGS=\"-DNDEBUG \"" -DOMPI_BUILD_CXXCPPFLAGS=\"@CXXCPPFLAGS@\" -DOMPI_BUILD_FFLAGS=\"\" -DOMPI_BUILD_FCFLAGS=\"\" -DOMPI_BUILD_LDFLAGS=\"\" "-DOMPI_BUILD_LIBS=\"-lm  /2/sw/HPC/src/openmpi-5.0.7/3rd-party/libevent-2.1.12-stable-ompi/libevent_core.la /2/sw/HPC/src/openmpi-5.0.7/3rd-party/libevent-2.1.12-stable-ompi/libevent_pthreads.la /2/sw/HPC/src/openmpi-5.0.7/3rd-party/hwloc-2.7.1/hwloc/libhwloc.la /2/sw/HPC/src/openmpi-5.0.7/3rd-party/openpmix/src/libpmix.la\"" -DOPAL_CC_ABSOLUTE=\"/2/sw/spack/opt/spack/linux-rocky9-x86_64_v3/gcc-11.4.1/aocc-5.0.0-7bkalkd6lei7daktomzuoomjtqf4l7wp/bin/clang\" -DOMPI_CXX_ABSOLUTE=\"/2/sw/spack/opt/spack/linux-rocky9-x86_64_v3/gcc-11.4.1/aocc-5.0.0-7bkalkd6lei7daktomzuoomjtqf4l7wp/bin/clang++\" -O3 -DNDEBUG -finline-functions -mcx16 -o .libs/ompi_info ompi_info.o param.o  ../../../ompi/.libs/libmpi.so -L/opt/mellanox/hcoll/lib -L../src/hcoll/commpatterns -L../src/hcoll/netpatterns -L/usr/lib64 -L/usr/lib /opt/mellanox/hcoll/lib/libhcoll.so /opt/mellanox/hcoll/lib/libocoms.so -lrt -lrdmacm -libverbs -lpthread /2/sw/HPC/src/openmpi-5.0.7/opal/.libs/libopen-pal.so ../../../opal/.libs/libopen-pal.so -lucp -lucs -lucm -luct /2/sw/HPC/src/openmpi-5.0.7/3rd-party/openpmix/src/.libs/libpmix.so -lmunge -ldl /2/sw/HPC/src/openmpi-5.0.7/3rd-party/libevent-2.1.12-stable-ompi/.libs/libevent_core.so /2/sw/HPC/src/openmpi-5.0.7/3rd-party/libevent-2.1.12-stable-ompi/.libs/libevent_pthreads.so /2/sw/HPC/src/openmpi-5.0.7/3rd-party/hwloc-2.7.1/hwloc/.libs/libhwloc.so -lm -Wl,-rpath -Wl,/2/sw/HPC/openmpi/5.0.7/lib
ld.lld: error: undefined reference due to --no-allow-shlib-undefined: __extendhfsf2
>>> referenced by ../../../ompi/.libs/libmpi.so

ld.lld: error: undefined reference due to --no-allow-shlib-undefined: __truncsfhf2
>>> referenced by ../../../ompi/.libs/libmpi.so
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make[2]: *** [Makefile:1478: ompi_info] Error 1
make[2]: Leaving directory '/2/sw/HPC/src/openmpi-5.0.7/ompi/tools/ompi_info'
make[1]: *** [Makefile:2710: all-recursive] Error 1
make[1]: Leaving directory '/2/sw/HPC/src/openmpi-5.0.7/ompi'
make: *** [Makefile:1539: all-recursive] Error 1

The full report is here: https://urldefense.com/v3/__https://macdrive.mcmaster.ca/f/5879ebda7cfe49c283fe/__;!!KGKeukY!xyX04qOWTVd8yh6Z9MzPY_jJZIq060U7v7zcjNZL86tTYyzaiUoPssYvQpFKFn8IUywVFarDbNuAZskXkQttKSUabVlcBg$

Trying the MVAPICH-4.0-plus rpm, I Geta. Similar error:

bbserv:~ $ sudo rpm --prefix=/2/sw/HPC/mvapich2/4.0-plus -Umvapich-plus-4.0-nogpu.rhel9.ofed24.10.ucx.gcc13.2.0.slurm-4.0-1.x86_64.rpmrpm
Updating / installing...
   1:mvapich-plus-4.0-nogpu.rhel9.ofed################################# [100%]
bbserv:~ $ export PATH=/2/sw/HPC/mvapich2/4.0-plus/bin:$PATH
bbserv:~ $ export LD_LIBRARY_PATH=/2/sw/HPC/mvapich2/4.0-plus/lib:$LD_LIBRARY_PATH
bbserv:~ $ cd Development/SandBox/MPI
bbserv:MPI $ which mpicc
/2/sw/HPC/mvapich2/4.0-plus/bin/mpicc
bbserv:MPI $ mpicc -o cpi cpi.c
/usr/bin/ld: /2/sw/HPC/mvapich2/4.0-plus/lib/libmpi.so: undefined reference to `__extendhfsf2'
/usr/bin/ld: /2/sw/HPC/mvapich2/4.0-plus/lib/libmpi.so: undefined reference to `__truncsfhf2'
collect2: error: ld returned 1 exit status

I have been trying to figure out which library is supposed to provide these two symbols, without luck so far.

Has anybody encountered the same problem?

Regards,
Blaise

—
Canada Research Chair in Mathematical and Computational Aspects of Solid Mechanics (Tier 1)
Professor, Department of Mathematics & Statistics
Hamilton Hall room 409A, McMaster University
1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada
https://urldefense.com/v3/__https://www.math.mcmaster.ca/bourdin__;!!KGKeukY!xyX04qOWTVd8yh6Z9MzPY_jJZIq060U7v7zcjNZL86tTYyzaiUoPssYvQpFKFn8IUywVFarDbNuAZskXkQttKSXhA-wKxg$  | +1 (905) 525 9140 ext. 27243

_______________________________________________
Mvapich-discuss mailing list
Mvapich-discuss at lists.osu.edu
https://lists.osu.edu/mailman/listinfo/mvapich-discuss
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osu.edu/pipermail/mvapich-discuss/attachments/20250408/e3bde924/attachment-0002.html>