[mvapich-discuss] leaked context IDs detected

Hari Subramoni subramoni.1 at osu.edu
Thu Aug 27 17:22:17 EDT 2015 

Hello Amit,

Can you please try with the latest 2.2a release of MVAPICH2? We made some
memory leak related fixes there. If the memory leaks don't go away, could
you please send us the following?

1. A reproducer
2. The output of mpiname -a
3. The compilers and the version of compilers used

Regards,
Hari.
On Aug 27, 2015 10:33 AM, "Kumar, Amit" <ahkumar at mail.smu.edu> wrote:

> --===============7360213391102858138==
> Content-Language: en-US
> Content-Type: multipart/alternative;
>
> boundary="_000_BB6BA2C397CCB140A2475E542B21644729C06AF6SXMB1PGSYSTEMSS_"
>
> --_000_BB6BA2C397CCB140A2475E542B21644729C06AF6SXMB1PGSYSTEMSS_
> Content-Type: text/plain; charset="us-ascii"
> Content-Transfer-Encoding: quoted-printable
>
> Dear MVAPICH2-2.1 compiled using GCC-5.10
>
> I see these strange messages after job completion. I see this not just for
> =
> my own programs but even for establish applications like NAMD that are
> comp=
> iled with mvapich2.
>
> Any insight into what these errors/information mean could be a great help.
>
> Please let me know if you need more information.
>
> Regards,
> Amit
>
> leaked context IDs detected: mask=3D0x7f6b87f77b00 mask[0]=3D0x5fffffff
> In direct memory block for handle type GROUP, 2 handles are still allocated
> In direct memory block for handle type ATTR, 1 handles are still allocated
> In direct memory block for handle type KEYVAL, 1 handles are still
> allocate=
> d
> In direct memory block for handle type COMM, 4 handles are still allocated
> leaked context IDs detected: mask=3D0x7f54a0d0cb00 mask[0]=3D0x5fffffff
> In direct memory block for handle type GROUP, 2 handles are still allocated
> In direct memory block for handle type ATTR, 1 handles are still allocated
> In direct memory block for handle type KEYVAL, 1 handles are still
> allocate=
> d
> In direct memory block for handle type COMM, 4 handles are still allocated
> leaked context IDs detected: mask=3D0x7fa53a90bb00 mask[0]=3D0x5fffffff
> In direct memory block for handle type GROUP, 2 handles are still allocated
> In direct memory block for handle type ATTR, 1 handles are still allocated
> In direct memory block for handle type KEYVAL, 1 handles are still
> allocate=
> d
> In direct memory block for handle type COMM, 4 handles are still allocated
> leaked context IDs detected: mask=3D0x7fbb9fb79b00 mask[0]=3D0x5fffffff
> In direct memory block for handle type GROUP, 2 handles are still allocated
> In direct memory block for handle type ATTR, 1 handles are still allocated
> In direct memory block for handle type KEYVAL, 1 handles are still
> allocate=
> d
> In direct memory block for handle type COMM, 4 handles are still allocated
> leaked context IDs detected: mask=3D0x7fcadcb4db00 mask[0]=3D0x5fffffff
> In direct memory block for handle type GROUP, 2 handles are still allocated
> In direct memory block for handle type ATTR, 1 handles are still allocated
> In direct memory block for handle type KEYVAL, 1 handles are still
> allocate=
> d
> In direct memory block for handle type COMM, 4 handles are still allocated
> leaked context IDs detected: mask=3D0x7f5f9c367b00 mask[0]=3D0x5fffffff
> In direct memory block for handle type GROUP, 2 handles are still allocated
> In direct memory block for handle type ATTR, 1 handles are still allocated
> In direct memory block for handle type KEYVAL, 1 handles are still
> allocate=
> d
> In direct memory block for handle type COMM, 4 handles are still allocated
> leaked context IDs detected: mask=3D0x7f7ef2708b00 mask[0]=3D0x1fffffff
> In direct memory block for handle type GROUP, 3 handles are still allocated
> In direct memory block for handle type ATTR, 1 handles are still allocated
> In direct memory block for handle type KEYVAL, 1 handles are still
> allocate=
> d
> In direct memory block for handle type COMM, 4 handles are still allocated
> In indirect memory block 0 for handle type COMM, 3 handles are still
> alloca=
> ted
> leaked context IDs detected: mask=3D0x7ff23a634b00 mask[0]=3D0x5fffffff
> In direct memory block for handle type GROUP, 2 handles are still allocated
> In direct memory block for handle type ATTR, 1 handles are still allocated
> In direct memory block for handle type KEYVAL, 1 handles are still
> allocate=
> d
> In direct memory block for handle type COMM, 4 handles are still allocated
>
>
> [0] 256 at [0x000000002c18ff18], src/mpi/coll/ch3_shmem_coll.c[4146]
> [0] 256 at [0x000000002c18fd68], src/mpi/coll/ch3_shmem_coll.c[4146]
> [0] 256 at [0x000000002c18fbb8], src/mpi/coll/ch3_shmem_coll.c[4146]
> [0] 256 at [0x000000002b6570b8], src/mpi/coll/ch3_shmem_coll.c[4146]
> [0] 256 at [0x000000002b656f08], src/mpi/coll/ch3_shmem_coll.c[4146]
> [0] 256 at [0x000000002b656d58], src/mpi/coll/ch3_shmem_coll.c[4146]
> [1] 256 at [0x000000002aa128a8], src/mpi/coll/ch3_shmem_coll.c[4146]
> [1] 256 at [0x000000002aa126f8], src/mpi/coll/ch3_shmem_coll.c[4146]
> [1] 256 at [0x000000002b55b458], src/mpi/coll/ch3_shmem_coll.c[4146]
> [1] 256 at [0x000000002b55b2a8], src/mpi/coll/ch3_shmem_coll.c[4146]
> [1] 256 at [0x000000002b55b0f8], src/mpi/coll/ch3_shmem_coll.c[4146]
> [1] 256 at [0x000000002b55af48], src/mpi/coll/ch3_shmem_coll.c[4146]
> [1] 256 at [0x000000002b55ad98], src/mpi/coll/ch3_shmem_coll.c[4146]
> [1] 256 at [0x000000002b55abe8], src/mpi/coll/ch3_shmem_coll.c[4146]
> [1] 64 at [0x000000002b55aaf8], src/mpi/coll/ch3_shmem_coll.c[4142]
> [1] 208 at [0x000000002a76f828], src/mpi/coll/ch3_shmem_coll.c[4045]
> [1] 88 at [0x000000002a76f9a8], src/mpid/ch3/src/mpid_vc.c[132]
> [1] 32 at [0x000000002a76f758], src/util/procmap/local_proc.c[93]
> [1] 32 at [0x000000002a76f688], src/util/procmap/local_proc.c[92]
> [1] 88 at [0x000000002a76f3e8], src/mpid/ch3/src/mpid_vc.c[132]
> [1] 128 at [0x000000002acc95b8], src/mpi/group/grouputil.c[77]
> [1] 128 at [0x000000002b2a7138], src/mpi/group/grouputil.c[77]
> [1] 32 at [0x000000002aa1d6b8], src/mpi/comm/create_2level_comm.c[761]
> [1] 32 at [0x000000002af7e808], src/mpi/comm/create_2level_comm.c[738]
> [1] 16 at [0x0000000000aa8b78], src/mpi/topo/cart_create.c[141]
> [1] 16 at [0x0000000000aae918], src/mpi/topo/cart_create.c[139]
> [1] 16 at [0x0000000000aaf908], src/mpi/topo/cart_create.c[137]
> [1] 64 at [0x0000000000aa73d8], src/mpi/topo/cart_create.c[131]
> [1] 88 at [0x0000000000aafcf8], src/mpid/ch3/src/mpid_vc.c[132]
> [1] 32 at [0x0000000000aafaa8], src/util/procmap/local_proc.c[93]
> [1] 32 at [0x0000000000aaf9d8], src/util/procmap/local_proc.c[92]
> [1] 88 at [0x0000000000aae818], src/mpid/ch3/src/mpid_vc.c[132]
> [1] 504 at [0x0000000000aaf118], src/mpi/comm/commutil.c[337]
> [1] 504 at [0x0000000000aaebd8], src/mpi/comm/commutil.c[337]
>
> Thank you, Amit H. Kumar,
> https://wiki.smu.edu/display/smuhpc/SMU+HPC+Wiki
>
>
> --_000_BB6BA2C397CCB140A2475E542B21644729C06AF6SXMB1PGSYSTEMSS_
> Content-Type: text/html; charset="us-ascii"
> Content-Transfer-Encoding: quoted-printable
>
> <html xmlns:v=3D"urn:schemas-microsoft-com:vml"
> xmlns:o=3D"urn:schemas-micr=
> osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word"
> =
> xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml"
> xmlns=3D"http:=
> //www.w3.org/TR/REC-html40">
> <head>
> <meta http-equiv=3D"Content-Type" content=3D"text/html;
> charset=3Dus-ascii"=
> >
> <meta name=3D"Generator" content=3D"Microsoft Word 14 (filtered medium)">
> <style><!--
> /* Font Definitions */
> @font-face
>         {font-family:Cambria;
>         panose-1:2 4 5 3 5 4 6 3 2 4;}
> @font-face
>         {font-family:Calibri;
>         panose-1:2 15 5 2 2 2 4 3 2 4;}
> /* Style Definitions */
> p.MsoNormal, li.MsoNormal, div.MsoNormal
>         {margin:0in;
>         margin-bottom:.0001pt;
>         font-size:11.0pt;
>         font-family:"Calibri","sans-serif";}
> a:link, span.MsoHyperlink
>         {mso-style-priority:99;
>         color:blue;
>         text-decoration:underline;}
> a:visited, span.MsoHyperlinkFollowed
>         {mso-style-priority:99;
>         color:purple;
>         text-decoration:underline;}
> span.EmailStyle17
>         {mso-style-type:personal-compose;
>         font-family:"Calibri","sans-serif";
>         color:black;}
> .MsoChpDefault
>         {mso-style-type:export-only;
>         font-family:"Calibri","sans-serif";}
> @page WordSection1
>         {size:8.5in 11.0in;
>         margin:1.0in 1.0in 1.0in 1.0in;}
> div.WordSection1
>         {page:WordSection1;}
> --></style><!--[if gte mso 9]><xml>
> <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
> </xml><![endif]--><!--[if gte mso 9]><xml>
> <o:shapelayout v:ext=3D"edit">
> <o:idmap v:ext=3D"edit" data=3D"1" />
> </o:shapelayout></xml><![endif]-->
> </head>
> <body lang=3D"EN-US" link=3D"blue" vlink=3D"purple">
> <div class=3D"WordSection1">
> <p class=3D"MsoNormal"><span style=3D"color:black">Dear MVAPICH2-2.1
> compil=
> ed using GCC-5.10<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span
> style=3D"color:black"><o:p> </o:p></span>=
> </p>
> <p class=3D"MsoNormal"><span style=3D"color:black">I see these strange
> mess=
> ages after job completion. I see this not just for my own programs but
> even=
>  for establish applications like NAMD that are compiled with mvapich2.
> <o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span
> style=3D"color:black"><o:p> </o:p></span>=
> </p>
> <p class=3D"MsoNormal"><span style=3D"color:black">Any insight into what
> th=
> ese errors/information mean could be a great help.
> <o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span
> style=3D"color:black"><o:p> </o:p></span>=
> </p>
> <p class=3D"MsoNormal"><span style=3D"color:black">Please let me know if
> yo=
> u need more information.<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span
> style=3D"color:black"><o:p> </o:p></span>=
> </p>
> <p class=3D"MsoNormal"><span style=3D"color:black">Regards,<br>
> Amit<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span
> style=3D"color:black"><o:p> </o:p></span>=
> </p>
> <p class=3D"MsoNormal"><span style=3D"color:black">leaked context IDs
> detec=
> ted: mask=3D0x7f6b87f77b00 mask[0]=3D0x5fffffff<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type GROUP, 2 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type ATTR, 1 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type KEYVAL, 1 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type COMM, 4 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">leaked context IDs
> detec=
> ted: mask=3D0x7f54a0d0cb00 mask[0]=3D0x5fffffff<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type GROUP, 2 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type ATTR, 1 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type KEYVAL, 1 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type COMM, 4 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">leaked context IDs
> detec=
> ted: mask=3D0x7fa53a90bb00 mask[0]=3D0x5fffffff<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type GROUP, 2 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type ATTR, 1 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type KEYVAL, 1 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type COMM, 4 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">leaked context IDs
> detec=
> ted: mask=3D0x7fbb9fb79b00 mask[0]=3D0x5fffffff<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type GROUP, 2 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type ATTR, 1 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type KEYVAL, 1 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type COMM, 4 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">leaked context IDs
> detec=
> ted: mask=3D0x7fcadcb4db00 mask[0]=3D0x5fffffff<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type GROUP, 2 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type ATTR, 1 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type KEYVAL, 1 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type COMM, 4 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">leaked context IDs
> detec=
> ted: mask=3D0x7f5f9c367b00 mask[0]=3D0x5fffffff<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type GROUP, 2 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type ATTR, 1 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type KEYVAL, 1 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type COMM, 4 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">leaked context IDs
> detec=
> ted: mask=3D0x7f7ef2708b00 mask[0]=3D0x1fffffff<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type GROUP, 3 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type ATTR, 1 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type KEYVAL, 1 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type COMM, 4 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In indirect memory
> block=
>  0 for handle type COMM, 3 handles are still
> allocated<o:p></o:p></span></p=
> >
> <p class=3D"MsoNormal"><span style=3D"color:black">leaked context IDs
> detec=
> ted: mask=3D0x7ff23a634b00 mask[0]=3D0x5fffffff<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type GROUP, 2 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type ATTR, 1 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type KEYVAL, 1 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">In direct memory block
> f=
> or handle type COMM, 4 handles are still allocated<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span
> style=3D"color:black"><o:p> </o:p></span>=
> </p>
> <p class=3D"MsoNormal"><span
> style=3D"color:black"><o:p> </o:p></span>=
> </p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[0] 256 at
> [0x000000002c=
> 18ff18], src/mpi/coll/ch3_shmem_coll.c[4146]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[0] 256 at
> [0x000000002c=
> 18fd68], src/mpi/coll/ch3_shmem_coll.c[4146]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[0] 256 at
> [0x000000002c=
> 18fbb8], src/mpi/coll/ch3_shmem_coll.c[4146]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[0] 256 at
> [0x000000002b=
> 6570b8], src/mpi/coll/ch3_shmem_coll.c[4146]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[0] 256 at
> [0x000000002b=
> 656f08], src/mpi/coll/ch3_shmem_coll.c[4146]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[0] 256 at
> [0x000000002b=
> 656d58], src/mpi/coll/ch3_shmem_coll.c[4146]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 256 at
> [0x000000002a=
> a128a8], src/mpi/coll/ch3_shmem_coll.c[4146]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 256 at
> [0x000000002a=
> a126f8], src/mpi/coll/ch3_shmem_coll.c[4146]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 256 at
> [0x000000002b=
> 55b458], src/mpi/coll/ch3_shmem_coll.c[4146]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 256 at
> [0x000000002b=
> 55b2a8], src/mpi/coll/ch3_shmem_coll.c[4146]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 256 at
> [0x000000002b=
> 55b0f8], src/mpi/coll/ch3_shmem_coll.c[4146]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 256 at
> [0x000000002b=
> 55af48], src/mpi/coll/ch3_shmem_coll.c[4146]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 256 at
> [0x000000002b=
> 55ad98], src/mpi/coll/ch3_shmem_coll.c[4146]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 256 at
> [0x000000002b=
> 55abe8], src/mpi/coll/ch3_shmem_coll.c[4146]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 64 at
> [0x000000002b5=
> 5aaf8], src/mpi/coll/ch3_shmem_coll.c[4142]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 208 at
> [0x000000002a=
> 76f828], src/mpi/coll/ch3_shmem_coll.c[4045]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 88 at
> [0x000000002a7=
> 6f9a8], src/mpid/ch3/src/mpid_vc.c[132]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 32 at
> [0x000000002a7=
> 6f758], src/util/procmap/local_proc.c[93]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 32 at
> [0x000000002a7=
> 6f688], src/util/procmap/local_proc.c[92]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 88 at
> [0x000000002a7=
> 6f3e8], src/mpid/ch3/src/mpid_vc.c[132]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 128 at
> [0x000000002a=
> cc95b8], src/mpi/group/grouputil.c[77]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 128 at
> [0x000000002b=
> 2a7138], src/mpi/group/grouputil.c[77]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 32 at
> [0x000000002aa=
> 1d6b8], src/mpi/comm/create_2level_comm.c[761]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 32 at
> [0x000000002af=
> 7e808], src/mpi/comm/create_2level_comm.c[738]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 16 at
> [0x0000000000a=
> a8b78], src/mpi/topo/cart_create.c[141]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 16 at
> [0x0000000000a=
> ae918], src/mpi/topo/cart_create.c[139]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 16 at
> [0x0000000000a=
> af908], src/mpi/topo/cart_create.c[137]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 64 at
> [0x0000000000a=
> a73d8], src/mpi/topo/cart_create.c[131]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 88 at
> [0x0000000000a=
> afcf8], src/mpid/ch3/src/mpid_vc.c[132]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 32 at
> [0x0000000000a=
> afaa8], src/util/procmap/local_proc.c[93]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 32 at
> [0x0000000000a=
> af9d8], src/util/procmap/local_proc.c[92]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 88 at
> [0x0000000000a=
> ae818], src/mpid/ch3/src/mpid_vc.c[132]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 504 at
> [0x0000000000=
> aaf118], src/mpi/comm/commutil.c[337]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span style=3D"color:black">[1] 504 at
> [0x0000000000=
> aaebd8], src/mpi/comm/commutil.c[337]<o:p></o:p></span></p>
> <p class=3D"MsoNormal"><span
> style=3D"color:black"><o:p> </o:p></span>=
> </p>
> <p class=3D"MsoNormal"><b><span
> style=3D"font-size:10.0pt;font-family:&quot=
> ;Cambria","serif";color:#1F497D">Thank you, Amit H.
> Kumar,&n=
> bsp;
> </span></b><span style=3D"color:black"><a href=3D"
> https://wiki.smu.edu/disp=
> lay/smuhpc/SMU+HPC+Wiki"><span style=3D"color:blue">
> https://wiki.sm=
> u.edu/display/smuhpc/SMU+HPC+Wiki</span></a><o:p></o:p></span></p>
> <p class=3D"MsoNormal"><o:p> </o:p></p>
> </div>
> </body>
> </html>
>
> --_000_BB6BA2C397CCB140A2475E542B21644729C06AF6SXMB1PGSYSTEMSS_--
>
> --===============7360213391102858138==
> Content-Type: text/plain; charset="us-ascii"
> MIME-Version: 1.0
> Content-Transfer-Encoding: 7bit
> Content-Disposition: inline
>
> _______________________________________________
> mvapich-discuss mailing list
> mvapich-discuss at cse.ohio-state.edu
> http://mailman.cse.ohio-state.edu/mailman/listinfo/mvapich-discuss
>
> --===============7360213391102858138==--
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.cse.ohio-state.edu/pipermail/mvapich-discuss/attachments/20150827/af3cbd8a/attachment-0001.html>

More information about the mvapich-discuss mailing list