[mvapich-discuss] Error in initializing MVAPICH2 ptmalloc library with mpi4py

[Subramoni, Hari]

Hi, Jonatan.

Can you please try the following options one by one and let us know what performance you obseve?


  1.  Add “LD_PRELOAD=<full path to libmpi.so>” before your launch command
     *   E.g. LD_PRELOAD=/home/subramon/MVAPICH2/git/ install-dir/lib/libmpi.so mpirun_rsh -np xx -hostfile <hostfile> <path_to_executable>
  2.  Set MV2_VBUF_TOTAL_SIZE & MV2_IBA_EAGER_THRESHOLD to 128 KB

Thx,
Hari.

From: mvapich-discuss-bounces at cse.ohio-state.edu <mvapich-discuss-bounces at mailman.cse.ohio-state.edu> On Behalf Of Jonatan Martín
Sent: Monday, December 14, 2020 10:59 AM
To: mvapich-discuss at cse.ohio-state.edu <mvapich-discuss at mailman.cse.ohio-state.edu>
Subject: [mvapich-discuss] Error in initializing MVAPICH2 ptmalloc library with mpi4py

Hi,

I'm trying to run a Python code with mvapich2 2.3.5 with multiple nodes, but I get the following warning:

WARNING: Error in initializing MVAPICH2 ptmalloc library. Continuing without InfiniBand registration cache support.

The execution goes on, but with poor performance. I've read in another discussion (http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/2015-April/005532.html) that this issue was supposed to be solved in the version 2.2. I wanted to ask if this issue was already solved or it is really a problem with the configuration of mvapich2 in the cluster I'm using. Can you confirm this?

Also it is stated that you can modify the variables "MV2_VBUF_TOTAL_SIZE" and "MV2_IBA_EAGER_THRESHOLD" to get better performance, but I'm not sure how to tune these variables. What's the maximum recommended size you can use there? Or how do you know the optimal size?

Thank you very much and regards,

Jonatan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20201214/f26d0174/attachment.html>