[mvapich-discuss] mvapich2-1.7 + slurm alternate location problem

[Henderson, Brent]

I'm hitting an error trying to configure mvapich2 v1.7 with slurm that is installed in an alternate location.  Sorry in advance if this issue is already described elsewhere, but I didn't find searchable archives of this list.  The configure line that I'm using is:

% ./configure --with-slurm=/opt/slurm --prefix=/tmp/test_build --with-pmi=slurm --with-pm=no
(snip)
configure: ===== configuring src/pmi/slurm =====
configure: executing: /tmp/brent/mvapich2-1.7/src/pmi/slurm/configure  '--with-slurm=/opt/slurm' '--prefix=/tmp/test_build' '--with-pmi=slurm' '--with-pm=no' --disable-option-checking
RUNNING CONFIGURE FOR THE SLURM PMI
checking for make... make
(snip)
checking for unistd.h... yes
checking slurm/pmi.h usability... no
checking slurm/pmi.h presence... no
checking for slurm/pmi.h... no
configure: error: could not find slurm/pmi.h.  Configure aborted
configure: error: src/pmi/slurm configure failed
%

I would expect the build to automatically add the -I(alt_slurm_path)/include and -L(alt_slurm_path)/lib to the build on my behalf.  I can add them manually and things work as expected, but if someone has some cycles to look into this, that might save others a little work.  In the meantime, I used:

% ./configure --with-slurm=/opt/slurm --prefix=/tmp/test_build --with-pmi=slurm --with-pm=no \
       CPPFLAGS=-I/opt/slurm/include LDFLAGS="-L/opt/slurm/lib -Wl,-rpath,/opt/slurm/lib"
(snip)
configure: ===== configuring src/pmi/slurm =====
configure: executing: /tmp/brent/mvapich2-1.7/src/pmi/slurm/configure  '--with-slurm=/opt/slurm' '--prefix=/opt/pgas_tools/brent_test17_nohybrid' '--with-pmi=slurm' '--with-pm=no' 'CPPFLAGS=-I/opt/slurm/include  -I/tmp/brent/mvapich2-1.7/src/mpl/include -I/tmp/brent/mvapich2-1.7/src/mpl/include -I/tmp/brent/mvapich2-1.7/src/openpa/src (really long list of -I+/tmp/mvapich2... directories here) -I/tmp/brent/mvapich2-1.7/src/util/wrappers' 'LDFLAGS=-L/opt/slurm/lib -Wl,-rpath,/opt/slurm/lib  ' --disable-option-checking
RUNNING CONFIGURE FOR THE SLURM PMI
checking for make... make
(snip)
checking for unistd.h... yes
checking slurm/pmi.h usability... yes
checking slurm/pmi.h presence... yes
checking for slurm/pmi.h... yes
checking for fgrep... /bin/grep -F
checking for PMI_Init in -lpmi... yes
configure: creating ./config.status
(snip)

Which does successfully configure and build to use srun as the launcher.  (I did run into another issue which I will send in a minute, but I wanted to keep them separate.)  I used CPPFLAGS instead of CFLAGS as it worked with both the 1.7 kit and 1.7 rc1 kits that I had available locally.

In case it is useful, here are some details about the system configuration:

-bash-4.1$ cat /etc/redhat-release
Red Hat Enterprise Linux Server release 6.1 (Santiago)
-bash-4.1$ srun --version
slurm 2.2.1
-bash-4.1$ ls /opt/slurm
bin  etc  include  lib  libexec  sbin  share
-bash-4.1$ ls /opt/slurm/include
slurm
-bash-4.1$ ls /opt/slurm/include/slurm
pmi.h  slurmdb.h  slurm_errno.h  slurm.h  spank.h
-bash-4.1$ ls /opt/slurm/lib
libpmi.a     libpmi.so.0.0.0  libslurmdb.so         libslurm.so
libpmi.la    libslurm.a       libslurmdb.so.22      libslurm.so.22
libpmi.so    libslurmdb.a     libslurmdb.so.22.0.0  libslurm.so.22.0.0
libpmi.so.0  libslurmdb.la    libslurm.la           slurm
-bash-4.1$

Brent

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20111027/f153501a/attachment-0001.html