[mvapich-discuss] MPI_Cart_Create

[rcbord at wm.edu]

Hi,
   I am having an issue with the MVAPICH-0.9.9 compiled with PGI-7.0 with 
ofed 1.2 for infinaband.  We have be able to use it for 6 months without
any problem. I tried to port a users fortran code that runs under 
solaris-sparc without any problems. The code is fairly vanilla fotran-90
with mpi I know because I wrote it.  When I tried to port it to the Linux
Cluster it hangs a mpisendrecv function.  I included a simple test code 
that shows that the new communicator (comm2d) returned by the 
MPI_Cart_create function has multiple values.  Same code run on the 
sun sparc cluster returns a single value.  I am guessing it could be how
I compiled MVAPICH, but have tried a few more flags without any success.
  I tried this with MVAPICH2 also and got the same error, but I compiled it 
in a similar fashion.  Could it be a PGI problem?


   Has anyone else seen this?  Thanks for any help!

Program mpicart
! With input files
! Conversion of efit2d.f90 to 3d JPB 11-2007

   Implicit none

   include "mpif.h"

   Interface
      Subroutine read_model(Pdim0,Pdim1)
        Integer, Intent(out) ::Pdim0,Pdim1
      end Subroutine read_model
   end Interface

   Double Precision :: t1,t2
!
! define MPI variables
!
   Integer :: Pid, N_proc, ierr
   Integer :: comm2d = 0
   Integer :: status
   Integer :: period(2),Pdim_size(2),coords(2)
   Integer :: nbrleft,nbrright,nbrtop,nbrbottom
   Integer :: Pdim0, Pdim1
   Integer :: i, t, numt

   call MPI_INIT(ierr)
   call MPI_COMM_RANK(MPI_COMM_WORLD,Pid,ierr)
   call MPI_COMM_SIZE(MPI_COMM_WORLD,N_proc,ierr)

   if (Pid .EQ. 0) then
      call read_model(Pdim0,Pdim1)

   end if
!
! Broad cast input parameters values to all processors
!
   call MPI_Bcast(Pdim0,1,MPI_INTEGER,0, &
        &  MPI_COMM_WORLD,ierr)
   call MPI_Bcast(Pdim1,1,MPI_INTEGER,0, &
        &  MPI_COMM_WORLD,ierr)

   call MPI_BARRIER(MPI_COMM_WORLD,ierr)

   Pdim_size(1) = Pdim0
   Pdim_size(2) = Pdim1

   period(1) = 0
   period(2) = 0

   call MPI_Dims_create(N_proc,2,Pdim_size,ierr)

   call MPI_Cart_create(MPI_COMM_WORLD,2,Pdim_size,period,.true.,comm2d,ierr)
   do i = 0,N_proc-1
      if (Pid == i) then
         write(*,*) 'pid ',Pid,' mpi_comm_2d ',comm2d
      end if
   end do

   call MPI_BARRIER(MPI_COMM_WORLD,ierr)
   call MPI_Comm_free(comm2d,ierr)
   call MPI_FINALIZE(ierr)

end program mpicart

###################### OUTPUT #########################

Model parameters for mpicart test

   Processor Topology is (            3  by             4 )

  pid             0  mpi_comm_2d           140
  pid            11  mpi_comm_2d           138
  pid             2  mpi_comm_2d           140
  pid             4  mpi_comm_2d           140
  pid             6  mpi_comm_2d           140
  pid             8  mpi_comm_2d           140
  pid             3  mpi_comm_2d           138
  pid            10  mpi_comm_2d           140
  pid             1  mpi_comm_2d           138
  pid             5  mpi_comm_2d           138
  pid             7  mpi_comm_2d           138
  pid             9  mpi_comm_2d           138


Chris Bording
Application Analyst
High Performance Computing Group 
Information Technology
The College of William and Mary
(757)-221-3488
rcbord at wm.edu