[mvapich-discuss] how to build mvapich2 so to make it work on SR-IOV + KVM Enviroment

[Xiaoyi Lu]

Hi, Pharthiphan,

Thanks for your interest in our project.

For virtualized environments (like SR-IOV + KVM), we strongly recommend our users to use the MVAPICH2-Virt package. You can download it from http://mvapich.cse.ohio-state.edu/downloads/.

You can find the user guide of MVAPICH2-Virt from http://mvapich.cse.ohio-state.edu/userguide/virt/.

Thanks,
Xiaoyi

> On Mar 12, 2018, at 1:27 AM, Pharthiphan Asokan <pasokan at ddn.com> wrote:
> 
> Hi All,
> 
> how to build and run mvapich2 so to make it work on SR-IOV + KVM Enviroment
> 
> I tried the following, then ended up with Could not modify boot qp to RTR
> 
> [root at vcn01 ~]# /opt/ddn/mvapich/bin/mpirun -hosts vcn01,vcn02 -ppn 1 /opt/ddn/ior/bin/IOR-mvapich -a POSIX -w -r -t
> 1m -b 1m -o /tmp/pasokan_fuse/test1
> [src/mpid/ch3/channels/mrail/src/gen2/ring_startup.c:292] error(22): Could not modify boot qp to RTR
> [src/mpid/ch3/channels/mrail/src/gen2/ring_startup.c:292] error(22): Could not modify boot qp to RTR
> ===================================================================================
> =
> BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
> =
> PID 24752 RUNNING AT vcn02
> =
> EXIT CODE: 1
> =
> CLEANING UP REMAINING PROCESSES
> =
> YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
> ===================================================================================
> [proxy:0:0 at vcn01] HYDU_sock_write (utils/sock/sock.c:286): write error (Broken pipe)
> [proxy:0:0 at vcn01] main (pm/pmiserv/pmip.c:265): unable to send EXIT_STATUS command upstream
> [mpiexec at vcn01] HYDT_bscu_wait_for_completion (tools/bootstrap/utils/bscu_wait.c:76): one of the processes terminated
> badly; aborting
> [mpiexec at vcn01] HYDT_bsci_wait_for_completion (tools/bootstrap/src/bsci_wait.c:23): launcher returned error waiting
> for completion
> [mpiexec at vcn01] HYD_pmci_wait_for_completion (pm/pmiserv/pmiserv_pmci.c:218): launcher returned error waiting for
> completion
> [mpiexec at vcn01] main (ui/mpich/mpiexec.c:344): process manager error waiting for completion
> [root at vcn01 ~]#
> 
> Regrads,
> Pharthiphan
> _______________________________________________
> mvapich-discuss mailing list
> mvapich-discuss at cse.ohio-state.edu
> http://mailman.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss