[mvapich-discuss] cpu placement with mpiexec?

[Dhabaleswar Panda]

Joseph,

> Correct - it does work with mpiexec and mvapich2
> however does not work with the mvapich1x version with mpiexec. Passing that argument results in error.
>
> we can use the 2x version, i was more just curious.
>
> The key to us is that in our PBS environment, that jobs do terminate
> properly. This works well with mpiexec, but not always with
> mpirun_rsh. So when you say, mpirun_rsh is more scalable, what does
> scale refer to? And is there a way to make job termination/cleanup
> really solid with mpirun_rsh.

The new mpirun_rsh framework takes into account the modern multi-core
architectures (i.e., establishing connections first to a leader in a node
and then to other cores in that node in a hierarchical manner). Thus, the
start-up becomes faster and can scale to larger number of nodes/cores. The
job termination/cleanup issue with mpirun_rsh you are mentioning has been
solved with some of the recent patches. If you download and use mvapich
1.1RC1 or the trunk version of mvapich2 1.2 (not rc2), you will get these
fixes.  These fixes will be part of the formal mvapich 1.1 and mvapich2
1.2 releases (which are coming soon).

Thanks,

DK

>
> thanks.
> j
>
> ----- Original Message -----
> From: Lei Chai <chai.15 at osu.edu>
> Date: Friday, October 17, 2008 10:19 pm
> Subject: Re: [mvapich-discuss] cpu placement with mpiexec?
>
> > Joseph,
> >
> > If you are using mpiexec and mvapich2, you can use:
> >
> > $ mpiexec -n 4 -env MV2_CPU_MAPPING 0:1:4:5 ./a.out
> >
> > and mvapich2 supports mpirun_rsh too which is more scalable than
> > mpiexec. More info about cpu mapping in mvapich2 can be found in the
> > userguide:
> >
> > http://mvapich.cse.ohio-state.edu/support/user_guide_mvapich2-1.2rc2.html#x1-320006.8
> >
> > Lei
> >
> >
> > Joseph Hargitai wrote:
> > > Hi all:
> > >
> > > can one use/translate the
> > >
> > > mpirun_rsh -np 2  -hostfile $PBS_NODEFILE VIADEV_CPU_MAPPING=0,4  ./a.out
> > >
> > > construct to use with mpiexec when using mvapich1x versions?
> > >
> > >
> > > thanks,
> > > joseph
> > > _______________________________________________
> > > mvapich-discuss mailing list
> > > mvapich-discuss at cse.ohio-state.edu
> > > http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
> > >
> >
> _______________________________________________
> mvapich-discuss mailing list
> mvapich-discuss at cse.ohio-state.edu
> http://mail.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
>