[mvapich-discuss] Specifying multiple HCAs in hostfile

[Dalai, Santak]

Hello all,

I saw the format of hostfile in the userguide and it says a way to specify the host, the ranks and the HCA.

Hostfile Format
The mpirun_rsh hostfile format allows for users to specify hostnames, one per line, optionally with a multiplier, and HCA specification.
The multiplier allows you to save typing by allowing you to specify blocked distribution of MPI ranks using one line per hostname. The HCA specification allows you to force an MPI rank to use a particular HCA.
The optional components are delimited by a ':'. Comments and empty lines are also allowed. Comments start with '#' and continue to the next newline.

Sample hostfile

$ cat hosts
# sample hostfile for mpirun_rsh
host1           # rank 0 will be placed on host1
host2:2         # rank 1 and 2 will be placed on host 2
host3:hca1      # rank 3 will be on host3 and will used hca1
host4:4:hca2    # ranks 4 through 7 will be on host4 and use hca2

# if the number of processes specified for this job is greater than 8
# then the additional ranks will be assigned to the hosts in a cyclic
# fashion.  For example, rank 8 will be on host1 and ranks 9 and 10 will
# be on host2.


Is there a way to specify multiple HCAs for a rank? Let say for the above example I want to run rank3 on host3 with2 hcas-hca1 and hca2. How to achieve it?

Thanks,
Santak Dalai

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20150310/033518cd/attachment-0001.html>