[mvapich-discuss] Global Array Programing Issue on the MVAPICH2

[Yutaka Kubota]

Dear MVAPICH2 member,

This is Yutaka Kubota from Cray Japan Inc.

One of the user made program using global array function on MVAPICH2.
This program execute complete on 1 node and 16 cores environment.
However in the case of 4 node and 16 core ( 1 node use 4 core)
environment was appeared follows error message and program stop on the
way.

[4] Abort: Control shouldn't reach here in prototype, header 172 at line
274 in file ibv_recv.c

I recompiled MVAPICH2 and user program with debug option. We found issue
point of MVPAICH2 function name "MPIDI_CH3I_MRAIL_Parse_header" on the
source file ibv_recv.c. We understood this function prepared 37 header
type and if header type was not much their 37 header type, this is
appeared error message and stop on the way. We suspected this problem of
MVAPICH2.

Could you investigate why "MPIDI_CH3I_MRAIL_Parse_header" function can't
get 37 header types? And why this program get 3 digit number as header
type ( ex. 172, 274, .... )?

If you need this user program. I can send you because use already have
consisted that we send developer team.

* check header type source PATH
mvapich2-1.2p1/src/mpid/ch3/channels/mrail/src/gen2/ibv_recv.c

* 37 header types
MPIDI_CH3_PKT_FAST_EAGER_SEND
MPIDI_CH3_PKT_FAST_EAGER_SEND_WITH_REQ
MPIDI_CH3_PKT_EAGER_SEND
MPIDI_CH3_PKT_RNDV_REQ_TO_SEND
MPIDI_CH3_PKT_RNDV_READY_REQ_TO_SEND
MPIDI_CH3_PKT_RNDV_CLR_TO_SEND
MPIDI_CH3_PKT_RMA_RNDV_CLR_TO_SEND
MPIDI_CH3_PKT_RPUT_FINISH
MPIDI_CH3_PKT_NOOP
MPIDI_CH3_PKT_EAGER_SYNC_ACK
MPIDI_CH3_PKT_CANCEL_SEND_REQ
MPIDI_CH3_PKT_CANCEL_SEND_RESP
MPIDI_CH3_PKT_CM_SUSPEND
MPIDI_CH3_PKT_CM_REACTIVATION_DONE
MPIDI_CH3_PKT_CR_REMOTE_UPDATE
MPIDI_CH3_PKT_ADDRESS
MPIDI_CH3_PKT_PACKETIZED_SEND_START
MPIDI_CH3_PKT_PACKETIZED_SEND_DATA
MPIDI_CH3_PKT_RNDV_R3_DATA
MPIDI_CH3_PKT_EAGER_SYNC_SEND
MPIDI_CH3_PKT_READY_SEND
MPIDI_CH3_PKT_PUT
MPIDI_CH3_PKT_PUT_RNDV
MPIDI_CH3_PKT_GET_RNDV
MPIDI_CH3_PKT_GET
MPIDI_CH3_PKT_GET_RESP
MPIDI_CH3_PKT_ACCUMULATE
MPIDI_CH3_PKT_ACCUMULATE_RNDV
MPIDI_CH3_PKT_LOCK
MPIDI_CH3_PKT_LOCK_GRANTED
MPIDI_CH3_PKT_PT_RMA_DONE
MPIDI_CH3_PKT_LOCK_PUT_UNLOCK
MPIDI_CH3_PKT_LOCK_GET_UNLOCK
MPIDI_CH3_PKT_LOCK_ACCUM_UNLOCK
MPIDI_CH3_PKT_FLOW_CNTL_UPDATE
MPIDI_CH3_PKT_CLOSE
MPIDI_CH3_PKT_RGET_FINISH

Best regards

Yutaka Kubota, Cray Japan Inc.