[mvapich-discuss] Maximum resource allocation

[yogeshwar sonawane]

Hi all,

I am trying some experimentation with MVAPICH2 + uDAPL from OFED stack
on 2 & 4 nodes.
>From source code & trials, i got following info:-
Per process single DTO, single CR & single Connect EVD is created. All
EPs of that process will use these evds. Size of DTO evd = 6K.
Per process single PZ is created, which is used for all EPs & LMRs.

Is this correct ?

Now, i am using small cluster model while MVAPICH2 compilation. But i
want some inputs when medium & large cluster model is used.
Mainly the resource limits OR max resource allocations done like
1) no. of DTO evds per process remains 1 ?
2) maximum size of EVD ?
3) single PZ per process ?
4) maximum registered memory per process OR maximum registered memory
per node (considering 16 processes per node) ?
5) any other resource limit....

Somebody can share his/her experience when working on such big clusters.
Any link or reference in this direction will be helpful.

regards,
Yogeshwar