We have experienced a problem where nodes will die with a SIGBUS error when /dev/shm is full. A more explicit test to verify you got everything you mem mapped may help debug this system problem easier. both mvapich and mvapich2 seem to be affected. Thanks, Kevin