[mvapich-discuss] Re: [Rocks-Discuss] mvapich locked memory limit and queuing system

[John Leidel]

Noam, I've also seen this happen with SGE 6.0 [I suggest also posting
your question to the SGE users list].  It has to do with the SGE_EXECD
arbitrarily setting its memlimits very low.  As such, all child
processes retain the low ceiling.  Check the SGE startup scripts to see
if the execd startup section is setting the memlimits.  

cheers
john 

On Wed, 2007-10-10 at 16:07 -0400, Noam Bernstein wrote:
> Has anyone noticed a conflict between OFED/mvapich's desire for a  
> large locked memory
> limit and the queuing system?   I've upped the memlock  limit in /etc/ 
> security/limits.conf
> (and rebooted, so the queuing system daemons should be seeing the  
> larger limit).
> This allows me to run interactively.  However, jobs submitted through  
> our queuing system
> (SGE 6.0) still see the low memlock limit (32 kB), and can't increase  
> the limit.  I found a brief
> discussion of a similar problem in torque (this thread:
> http://www.beowulf.org/archive/2006-May/015559.html
> ), but no apparent solution.
> 
> Has anyone seen this problem, and preferably discovered a solution?
> 
> 											thanks,
> 											Noam