[MVAPICH-discuss] Install MVAPICH 1
Stecher, Fred
Fred.Stecher at atk.com
Mon Apr 14 15:34:28 EDT 2008
Jonathan,
You were right. The new build used the PGI compilers. I have rebuilt the
executable with the gen2 version of MVAPICH. I restarted my run and
InfiniBand was not used. I then ran the osu_bw program with the
following results:
# OSU MPI Bandwidth Test v3.0
# Size Bandwidth (MB/s)
1 2.46
2 5.07
4 9.83
8 18.69
16 35.98
32 69.31
64 125.95
128 225.55
256 354.17
512 491.20
1024 615.13
2048 727.53
4096 795.82
8192 861.88
16384 858.40
32768 906.21
65536 931.13
131072 943.26
262144 949.19
524288 952.36
1048576 954.01
2097152 954.83
4194304 955.25
I have attached the log files.
Thanks,
Fred
-----Original Message-----
From: Jonathan Perkins [mailto:perkinjo at cse.ohio-state.edu]
Sent: Monday, April 14, 2008 11:56 AM
To: Stecher, Fred
Subject: Re: [mvapich-discuss] Install MVAPICH 1
It looks like you're having a problem contacting the PGI Licensce
server. You may need to contact your sys admin to resolve this if the
issue still exists.
Try compiling a bare bones c program with pgcc to see if the problem
persists.
On Mon, Apr 14, 2008 at 11:24:39AM -0500, Stecher, Fred wrote:
>
>
> -----Original Message-----
> From: Jonathan Perkins [mailto:perkinjo at cse.ohio-state.edu]
> Sent: Monday, April 14, 2008 11:00 AM
> To: Stecher, Fred
> Subject: Re: [mvapich-discuss] Install MVAPICH 1
>
> One more file, "config.log" and I should be able to look into why pgCC
> couldn't be used. I believe there may be some mismatch between using
> gcc as your c compiler and pgf77 as the fortran compiler.
>
> In the meantime while I'm inspecting your log files you can try using
> gcc and
> gfortran/g77 as your compilers to rebuild MVAPICH. Then we can see if
> this error persists when you try to rebuild your mpi application.
>
> On Mon, Apr 14, 2008 at 10:29:32AM -0500, Stecher, Fred wrote:
> >
> >
> > -----Original Message-----
> > From: Jonathan Perkins [mailto:perkinjo at cse.ohio-state.edu]
> > Sent: Monday, April 14, 2008 10:16 AM
> > To: Stecher, Fred
> > Cc: mvapich-discuss at cse.ohio-state.edu
> > Subject: Re: [mvapich-discuss] Install MVAPICH 1
> >
> > On Fri, Apr 11, 2008 at 03:46:04PM -0500, Stecher, Fred wrote:
> > > Jonathan,
> > > When I tried to rebuild my application the following error message
> > > was
> > > output:
> > >
> > > /data1/home/fstecher/mvapich/usr/local/mvapich/lib/libfmpich.a(dup
> > > _f
> > > nf
> > > .o
> > > ): In function `pmpi_dup_fn_':
> > > dup_fnf.c:(.text+0x23): undefined reference to `MPIR_F_TRUE'
> > > dup_fnf.c:(.text+0x2a): undefined reference to `MPIR_F_FALSE'
> > > /data1/home/fstecher/mvapich/usr/local/mvapich/lib/libfmpich.a(ini
> > > ti
> > > al
> > > iz
> > > ef.o): In function `pmpi_initialized_':
> > > initializef.c:(.text+0x27): undefined reference to `MPIR_F_TRUE'
> > > initializef.c:(.text+0x2e): undefined reference to `MPIR_F_FALSE'
> > > /data1/home/fstecher/mvapich/usr/local/mvapich/lib/libfmpich.a(nul
> > > l_
> > > co
> > > py
> > > fnf.o): In function `pmpi_null_copy_fn_':
> > > null_copyfnf.c:(.text+0x6): undefined reference to `MPIR_F_FALSE'
> >
> > This looks like it may have something to do with the Fortran
bindings.
> > Can you forward us those other log files?
> >
> > >
> > > Thanks,
> > >
> > > Fred
> > >
> > >
> > > -----Original Message-----
> > > From: Jonathan Perkins [mailto:perkinjo at cse.ohio-state.edu]
> > > Sent: Friday, April 11, 2008 7:37 AM
> > > To: Stecher, Fred
> > > Cc: mvapich-discuss at cse.ohio-state.edu
> > > Subject: Re: [mvapich-discuss] Install MVAPICH 1
> > >
> > > After you reinstalled MVAPICH, did you also rebuild your MPI
> > > application before running? It's possible that you were still
> > > using
>
> > > the old library when you restarted.
> > >
> > > In order to debug the compiler issue I'd like to see the other log
> > > files as well. Specifically the config.log and the
config-mine.log.
> > >
> > > On Thu, Apr 10, 2008 at 04:49:41PM -0500, Stecher, Fred wrote:
> > > > Jonathan,
> > > > I performed the ./make.mvapich.gen2 command and output to a
> > > > make.log
> >
> > > > file. In the make.log file there was a Warning message. Also,
> > > > the pgcc
> > >
> > > > compiler was not used. No Fortran compiler was used either. I
> > > > have
>
> > > > attached the make.log file. I then restarted my run. Monitoring
> > > > the
> >
> > > > InfiniBand network traffic indicated no traffic. Monitoring
> > > > Ethernet
> >
> > > > indicated some traffic. I do not think that InfiniBand is being
> > used.
> > > >
> > > >
> > > > Thanks,
> > > >
> > > > Fred
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Jonathan L. Perkins [mailto:perkinjo at cse.ohio-state.edu]
> > > > Sent: Thursday, April 10, 2008 12:06 PM
> > > > To: Stecher, Fred
> > > > Subject: Re: [mvapich-discuss] Install MVAPICH 1
> > > >
> > > > On Thu, Apr 10, 2008 at 11:53:37AM -0500, Stecher, Fred wrote:
> > > > > So,
> > > > > How do I make the InfiniBand version if make -f
> > > > > make.mvapich.gen2
> >
> > > > > Errors out?
> > > >
> > > > Don't call make yourself. Just type in './make.mvapich.gen2' at
> > > > the
> >
> > > > command line (without the quotes of course). Before doing this,
> > > > be sure to export any variables that you may need to override in
> > > > make.mvapich.gen2.
> > > >
> > > > For more information please see
> > > > http://mvapich.cse.ohio-state.edu/support/mvapich_user_guide.htm
> > > > l
> > > >
> > > > Section 4 should answer most of your questions.
> > > >
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Fred
> > > > >
> > > > > -----Original Message-----
> > > > > From: Jonathan L. Perkins [mailto:perkinjo at cse.ohio-state.edu]
> > > > > Sent: Thursday, April 10, 2008 11:50 AM
> > > > > To: Stecher, Fred
> > > > > Subject: Re: [mvapich-discuss] Install MVAPICH 1
> > > > >
> > > > > On Thu, Apr 10, 2008 at 11:23:49AM -0500, Stecher, Fred wrote:
> > > > > > Hi,
> > > > > > This is a follow-up to previous question concerning whether
> > > > > > MVAPICH
> > > > > > 1 is using InfiniBand or Ethernet. Upon monitoring network
> > > > > > traffic, my executable is definitely using Ethernet.
> > > > > > I have reinstalled MVAPICH. The user manual stated "Go to
> > > > > > the mvapich-1.0 directory. We have included a single script
> > > > > > for
> > > > > > OpenFabrics/Gen2 (make.mvapich.gen2) that takes care of
> > > > > > different platforms, compilers and architectures. By
> > > > > > default, the compilation script uses gcc. In order to select
> > > > > > your compiler, please set the variable CC in the script to
> > > > > > use either
> >
> > > > > > Intel, PathScale or PGI compiler. The platform/architecture
> > > > > > is
>
> > > > > > detected automatically." I tried make -f make.mvapich.gen2
> > > > > > with
> >
> > > > > > following error
> > > > >
> > > > > You should use ./make.mvapich.gen2
> > > > >
> > > > > > message:
> > > > > > make.mvapich.gen2:7: *** missing separator. Stop.
> > > > > > I then just typed make. This resulted in installation of
> > > > > > some version of MVAPICH. I am not sure what version. Do
> > > > > > anyone know
>
> > > > > > what version was installed or how to determine the version?
> > > > > >
> > > > >
> > > > > By using make directly you almost certainly have made the TCP
> > > version.
> > > > >
> > > > > > Thanks,
> > > > > >
> > > > > > Fred
> > > > > >
> > > > >
> > > > > > _______________________________________________
> > > > > > mvapich-discuss mailing list
> > > > > > mvapich-discuss at cse.ohio-state.edu
> > > > > > http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-disc
> > > > > > us
> > > > > > s
> > > > >
> > > > >
> > > > > --
> > > > > Jonathan Perkins
> > > > > http://www.cse.ohio-state.edu/~perkinjo
> > > >
> > > > --
> > > > Jonathan Perkins
> > > > http://www.cse.ohio-state.edu/~perkinjo
> > >
> > >
> > >
> > >
> > > --
> > > Jonathan Perkins
> > > http://www.cse.ohio-state.edu/~perkinjo
> >
> > --
> > Jonathan Perkins
> > http://www.cse.ohio-state.edu/~perkinjo
>
>
>
>
> --
> Jonathan Perkins
> http://www.cse.ohio-state.edu/~perkinjo
--
Jonathan Perkins
http://www.cse.ohio-state.edu/~perkinjo
-------------- next part --------------
A non-text attachment was scrubbed...
Name: make-mine.log_gz
Type: application/octet-stream
Size: 13310 bytes
Desc: make-mine.log_gz
Url : http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20080414/01f8a4ef/make-mine-0001.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: config.log
Type: application/octet-stream
Size: 7583 bytes
Desc: config.log
Url : http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20080414/01f8a4ef/config-0001.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: config-mine.log
Type: application/octet-stream
Size: 23176 bytes
Desc: config-mine.log
Url : http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20080414/01f8a4ef/config-mine-0001.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: install-mine.log
Type: application/octet-stream
Size: 2090 bytes
Desc: install-mine.log
Url : http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20080414/01f8a4ef/install-mine-0001.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: make.log_gz
Type: application/octet-stream
Size: 18479 bytes
Desc: make.log_gz
Url : http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20080414/01f8a4ef/make-0001.obj
More information about the mvapich-discuss
mailing list