Re: [mvapich-discuss] mvapich2 over uDAPL gives QP_FATAL error

[Ajay]

 Hi Lei,Thanks for explanation and suggestion.Regards,Ajay Original message From:Lei Chai< chai.15 at osu.edu >Date: 24 Mar 09 03:00:49Subject:Re: [mvapichdiscuss] mvapich2 over uDAPL gives QPFATAL errorTo: Ajay Hi Ajay,Thanks for your report and detailed information. We found a bug in thispart. Basically the noop message is to send credit to the remote side.So after certain number of receives(udapldynamiccreditthreshold/udaplcreditnotifythreshold) theprocess sends a noop message. Since the total number of receive buffersare 80 by default (udaplprepostdepth), there could be as many as 8noop messages outstanding and the remote side has to have at least 8receive buffers for receiving these noop messages. The current value(udaplprepostnoopextra) is 5 and that's why it failed. So yourworkarounds are actually fixes. I suggest you useudaplprepostnoopextra=8. We will fix it in our code base also.Thanks, Lei Ajay wrote: > Hello, > > I am using "mvapich21.2p1" of "OFED1.4.1RC1". I am try
 
 ing to run> mvapich2 over uDAPL ("compatdapl1.2.12" with "OpenIBCMA") and while> running IMBEXT application (of Intel MPI Benchmarks 3.2), I am> getting "IBVEVENTQPFATAL" event. I am getting error in "BidirGet"> API of IMBEXT. If I try to run only BidirGet of IMBEXT then test> works fine. > > Basically error is I have received some data but I don't have buffers> posted for same. > > I found some workarounds and will like to understand more. Following> are some queries: > >1. If value of "MV2PREPOSTDEPTH" variable (udaplprepostdepth) > iswhat's use of "remotecc" and "rdmacredit" variables? >3. If value of variables "udapldynamiccreditthreshold" and > "udaplcreditnotifythreshold" are changed from 10 to >=13 then > this test works fine (basically I was trying to send NOOP after > 15 postrecvs() instead of 10). I think NOOP sends are for > synchronization; so how does less no. of NOOPs are resolving > this issue? > > Thanks in Advance. > > Regards, > Ajay > > > > Dear *mvapichdi
 
 scuss!* Get Yourself a cool, short *@in.com* Email ID> now!>>  > >  > mvapichdiscuss mailing list > mvapichdiscuss at cse.ohiostate.edu > http://mail.cse.ohiostate.edu/mailman/listinfo/mvapichdiscuss > 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20090326/71c593a7/attachment.html