srun: defined options srun: -------------------- -------------------- srun: export : MV2_TWO_LEVEL_COMM_THRESHOLD=1,MV2_USE_RDMA_CM=0,MV2_TOOL_REPORT_PVARS=1,MV2_DEBUG_TOOL_VERBOSE=1,MV2_USE_SHMEM_COLL=1,MV2_ENABLE_PVAR_TIMER=1,MV2_ENABLE_PVAR_COUNTER=1,MV2_ENABLE_PVAR_TIMER_BUCKETS=1,MV2_ENABLE_PVAR_COUNTER_BUCKETS=1,MV2_TOOL_REPORT_SESSIONS=1,MV2_TOOL_SESSIONS_DEFAULT_ALL_HANDLES=1,MV2_TOOL_REPORT_LUSTRE_STATS=0,MV2_ON_DEMAND_THRESHOLD=1,MV2_TOOL_INFO_FILE_PATH=/etc/osu-inam/osu-inam.conf srun: mpi : pmi2 srun: ntasks : 12 srun: verbose : 1 srun: -------------------- -------------------- srun: end of defined options srun: Nodes rt03d are ready for job srun: jobid 104: nodes(1):`rt03d', cpu counts: 12(x1) srun: CpuBindType=(null type) srun: launching StepId=104.0 on host rt03d, 12 tasks: [0-11] srun: topology/default: init: topology Default plugin loaded srun: Node rt03d, 12 tasks started #------------------------------------------------------------ # Intel (R) MPI Benchmarks 4.0 Update 1, MPI-1 part #------------------------------------------------------------ # Date : Tue Feb 20 10:59:05 2024 # Machine : x86_64 # System : Linux # Release : 3.10.0-957.el7.x86_64 # Version : #1 SMP Thu Nov 8 23:39:32 UTC 2018 # MPI Version : 3.1 # MPI Thread Environment: # New default behavior from Version 3.2 on: # the number of iterations per message size is cut down # dynamically when a certain run time (per message size sample) # is expected to be exceeded. Time limit is defined by variable # "SECS_PER_SAMPLE" (=> IMB_settings.h) # or through the flag => -time # Calling sequence was: # /home/evancervj/imb_verbs/imb/src/./IMB-MPI1 -msglen 1Mfile_4K_inc -npmin 12 # Message lengths were user defined # # MPI_Datatype : MPI_BYTE # MPI_Datatype for reductions : MPI_FLOAT # MPI_Op : MPI_SUM # # # List of Benchmarks to run: # PingPong # PingPing # Sendrecv # Exchange # Allreduce # Reduce # Reduce_scatter # Allgather # Allgatherv # Gather # Gatherv # Scatter # Scatterv # Alltoall # Alltoallv # Bcast # Barrier #--------------------------------------------------- # Benchmarking PingPong # #processes = 2 # ( 10 additional processes waiting in MPI_Barrier) #--------------------------------------------------- #bytes #repetitions t[usec] Mbytes/sec 0 1000 0.64 0.00 4096 1000 1.77 2207.05 8192 1000 2.23 3502.54 12288 1000 2.12 5519.29 16384 1000 2.07 7553.71 20480 1000 2.23 8756.35 24576 1000 2.31 10144.89 28672 1000 2.51 10913.31 32768 1000 2.54 12319.95 36864 1000 2.68 13123.53 40960 1000 2.74 14261.84 45056 930 2.88 14899.18 49152 853 2.93 16018.59 53248 787 3.14 16194.06 57344 731 3.13 17485.15 61440 682 3.29 17796.59 65536 640 3.39 18449.68 69632 602 3.63 18294.02 73728 568 3.53 19933.36 77824 538 3.78 19644.27 81920 512 4.03 19407.97 86016 487 3.90 21038.25 90112 465 4.03 21324.21 94208 445 4.17 21548.48 98304 426 4.18 22452.92 102400 409 4.39 22250.82 106496 393 4.31 23577.45 110592 379 4.64 22720.89 114688 365 4.70 23286.90 118784 353 4.64 24410.28 122880 341 5.01 23399.18 126976 330 5.07 23877.53 131072 320 5.22 23929.85 135168 310 5.40 23879.23 139264 301 5.31 25007.29 143360 292 5.66 24164.01 147456 284 5.98 23520.08 151552 276 5.69 25415.98 155648 269 5.92 25063.94 159744 262 5.88 25915.13 163840 256 5.99 26092.09 167936 249 6.54 24478.89 172032 243 6.10 26876.98 176128 238 6.35 26457.41 180224 232 6.34 27122.01 184320 227 6.54 26887.71 188416 222 6.57 27354.44 192512 217 7.01 26205.66 196608 213 6.70 28002.34 200704 208 6.97 27446.70 204800 204 6.95 28105.75 208896 200 7.00 28469.64 212992 196 7.26 27975.49 217088 193 7.22 28655.54 221184 189 7.47 28252.95 225280 186 7.71 27883.60 229376 182 7.65 28578.77 233472 179 7.78 28604.71 237568 176 7.92 28606.49 241664 173 8.01 28775.96 245760 170 8.09 28980.63 249856 167 8.28 28783.96 253952 165 9.36 25863.49 258048 162 8.59 28635.17 262144 160 8.61 29038.89 266240 157 8.62 29467.52 270336 155 8.80 29284.24 274432 152 9.01 29038.40 278528 150 8.81 30160.04 282624 148 9.16 29430.68 286720 146 9.26 29542.07 290816 144 9.14 30359.77 294912 142 9.43 29835.25 299008 140 9.63 29596.90 303104 138 9.55 30274.75 307200 136 9.65 30365.55 311296 134 9.97 29768.89 315392 132 9.97 30162.47 319488 131 10.48 29062.01 323584 129 10.65 28967.62 327680 128 10.19 30674.13 331776 126 10.84 29192.58 335872 124 10.92 29342.58 339968 123 10.76 30126.85 344064 121 11.11 29536.53 348160 120 11.37 29200.91 352256 119 11.09 30304.33 356352 117 11.42 29751.63 360448 116 11.66 29491.78 364544 115 11.36 30603.20 368640 113 11.72 30006.35 372736 112 12.21 29101.73 376832 111 11.70 30710.98 380928 110 12.12 29975.56 385024 108 12.47 29454.64 389120 107 12.08 30713.39 393216 106 12.15 30851.88 397312 105 13.94 27175.48 401408 104 13.41 28554.33 405504 103 13.88 27858.54 409600 102 13.27 29434.93 413696 101 12.87 30666.64 417792 100 13.23 30124.70 421888 99 13.68 29421.09 425984 98 13.22 30741.11 430080 97 14.48 28324.03 434176 96 15.00 27610.10 438272 95 13.78 30330.24 442368 94 13.87 30424.43 446464 93 14.61 29142.76 450560 93 14.17 30319.88 454656 92 14.30 30315.89 458752 91 14.86 29435.17 462848 90 14.80 29821.08 466944 89 14.56 30579.85 471040 89 15.36 29237.25 475136 88 15.04 30132.04 479232 87 15.07 30330.59 483328 86 15.62 29518.83 487424 86 15.50 29981.91 491520 85 15.43 30373.83 495616 84 16.04 29471.19 499712 83 15.75 30255.20 503808 83 15.73 30539.39 507904 82 16.40 29535.06 512000 81 16.10 30335.19 516096 81 16.23 30317.31 520192 80 16.90 29355.69 524288 80 16.63 30072.08 528384 79 16.74 30095.41 532480 78 17.36 29248.90 536576 78 17.15 29831.02 540672 77 17.30 29800.82 544768 76 17.85 29113.03 548864 76 17.46 29985.56 552960 75 17.82 29588.51 557056 75 18.32 29003.26 561152 74 18.16 29476.66 565248 74 18.27 29508.54 569344 73 18.84 28817.55 573440 73 18.83 29047.53 577536 72 19.16 28752.01 581632 72 19.25 28816.45 585728 71 19.39 28809.62 589824 71 19.66 28612.18 593920 70 19.84 28546.49 598016 70 19.79 28812.61 602112 69 20.21 28412.19 606208 69 20.24 28561.52 610304 68 20.55 28318.44 614400 68 20.78 28191.09 618496 67 20.96 28142.09 622592 67 21.09 28146.87 626688 66 21.51 27782.64 630784 66 21.35 28170.00 634880 66 21.96 27569.43 638976 65 22.17 27480.57 643072 65 22.00 27880.39 647168 64 22.42 27534.49 651264 64 22.90 27116.14 655360 64 22.55 27719.48 659456 63 23.25 27050.20 663552 63 23.53 26889.94 667648 62 23.33 27289.11 671744 62 23.83 26880.60 675840 62 24.30 26524.50 679936 61 23.76 27291.39 684032 61 24.58 26539.01 688128 60 24.82 26438.92 692224 60 24.37 27086.29 696320 60 25.18 26371.60 700416 59 25.63 26066.10 704512 59 25.01 26866.74 708608 59 26.02 25971.66 712704 58 26.06 26086.19 716800 58 25.68 26618.26 720896 58 26.62 25823.80 724992 57 26.99 25621.67 729088 57 26.34 26396.52 733184 57 27.30 25609.49 737280 56 27.83 25265.93 741376 56 27.05 26138.07 745472 56 28.08 25318.13 749568 55 28.42 25155.21 753664 55 27.65 25992.49 757760 55 28.88 25019.84 761856 55 29.32 24783.13 765952 54 28.33 25782.40 770048 54 29.76 24674.44 774144 54 30.10 24523.74 778240 53 28.98 25613.11 782336 53 30.42 24525.73 786432 53 31.06 24147.09 790528 53 29.79 25304.54 794624 52 30.87 24548.02 798720 52 31.69 24035.56 802816 52 30.45 25140.88 806912 51 31.74 24241.23 811008 51 32.37 23896.24 815104 51 31.23 24888.67 819200 51 32.58 23980.03 823296 50 33.23 23629.07 827392 50 31.83 24788.91 831488 50 33.56 23630.21 835584 50 33.85 23540.89 839680 49 32.63 24541.80 843776 49 34.37 23410.02 847872 49 34.73 23284.70 851968 49 33.24 24445.28 856064 48 35.02 23312.43 860160 48 35.39 23179.05 864256 48 33.97 24265.14 868352 48 35.32 23445.87 872448 48 36.34 22894.83 876544 47 34.73 24072.79 880640 47 36.63 22930.79 884736 47 36.92 22853.86 888832 47 35.85 23646.84 892928 46 37.53 22690.06 897024 46 37.72 22678.27 901120 46 36.29 23678.13 905216 46 38.02 22707.53 909312 46 38.53 22506.51 913408 45 37.19 23425.72 917504 45 38.69 22615.64 921600 45 39.28 22374.97 925696 45 37.84 23331.97 929792 45 39.54 22425.64 933888 44 40.04 22242.95 937984 44 38.68 23124.41 942080 44 40.31 22290.26 946176 44 41.12 21941.76 950272 44 39.61 22880.89 954368 43 41.31 22033.73 958464 43 41.98 21774.64 962560 43 40.57 22625.26 966656 43 42.01 21941.91 970752 43 42.82 21621.15 974848 43 41.24 22544.38 978944 42 42.88 21770.15 983040 42 43.58 21511.00 987136 42 42.19 22315.66 991232 42 43.74 21611.44 995328 42 44.58 21290.44 999424 41 42.79 22272.80 1003520 41 44.83 21345.95 1007616 41 45.44 21146.46 1011712 41 43.86 21996.65 1015808 41 45.79 21155.95 1019904 41 46.38 20970.94 1024000 40 44.77 21813.34 1028096 40 46.78 20960.16 1032192 40 47.28 20819.50 1036288 40 45.82 21571.08 1040384 40 47.47 20903.05 1044480 40 48.45 20559.37 1048576 40 46.58 21467.97 #--------------------------------------------------- # Benchmarking PingPing # #processes = 2 # ( 10 additional processes waiting in MPI_Barrier) #--------------------------------------------------- #bytes #repetitions t[usec] Mbytes/sec 0 1000 0.47 0.00 4096 1000 1.23 3165.99 8192 1000 1.96 3981.05 12288 1000 2.20 5321.21 16384 1000 2.36 6633.87 20480 1000 2.51 7782.63 24576 1000 2.65 8859.41 28672 1000 2.79 9804.07 32768 1000 2.95 10578.85 36864 1000 3.09 11359.37 40960 1000 3.25 12002.93 45056 930 3.41 12600.23 49152 853 3.56 13171.02 53248 787 3.71 13697.07 57344 731 3.86 14182.01 61440 682 4.03 14526.64 65536 640 4.22 14807.78 69632 602 4.36 15234.77 73728 568 4.53 15521.68 77824 538 4.70 15795.27 81920 512 4.83 16178.61 86016 487 5.00 16414.50 90112 465 5.15 16694.06 94208 445 5.58 16103.93 98304 426 5.86 15989.88 102400 409 5.59 17461.58 106496 393 6.15 16505.15 110592 379 6.41 16466.06 114688 365 6.46 16922.13 118784 353 6.22 18201.09 122880 341 7.23 16215.98 126976 330 7.46 16241.12 131072 320 7.14 17510.92 135168 310 7.16 18008.84 139264 301 7.78 17074.73 143360 292 7.78 17579.47 147456 284 7.75 18152.36 151552 276 7.89 18317.65 155648 269 8.10 18325.56 159744 262 8.55 17817.34 163840 256 8.41 18589.71 167936 249 8.53 18768.43 172032 243 8.71 18828.41 176128 238 8.83 19032.22 180224 232 9.03 19029.23 184320 227 9.16 19192.95 188416 222 9.65 18611.06 192512 217 9.52 19291.20 196608 213 9.86 19015.78 200704 208 10.15 18857.79 204800 204 9.98 19561.84 208896 200 10.11 19714.14 212992 196 10.51 19331.53 217088 193 10.77 19217.05 221184 189 10.58 19930.29 225280 186 10.98 19559.85 229376 182 11.45 19108.10 233472 179 12.02 18530.76 237568 176 11.87 19087.86 241664 173 12.63 18242.77 245760 170 11.99 19548.11 249856 167 12.24 19466.27 253952 165 12.49 19383.41 258048 162 12.77 19277.74 262144 160 12.83 19490.26 266240 157 13.44 18896.78 270336 155 13.69 18826.05 274432 152 14.31 18295.47 278528 150 13.61 19522.99 282624 148 13.58 19842.67 286720 146 13.85 19748.14 290816 144 13.95 19880.13 294912 142 14.92 18848.88 299008 140 14.42 19778.46 303104 138 14.55 19863.87 307200 136 14.73 19885.39 311296 134 14.98 19821.18 315392 132 15.06 19972.05 319488 131 15.44 19732.64 323584 129 15.27 20214.21 327680 128 15.53 20123.80 331776 126 15.61 20266.04 335872 124 15.78 20301.31 339968 123 16.13 20103.88 344064 121 16.71 19642.25 348160 120 16.25 20429.93 352256 119 16.59 20255.36 356352 117 17.24 19717.75 360448 116 17.52 19620.82 364544 115 17.25 20157.50 368640 113 17.67 19893.18 372736 112 18.17 19560.24 376832 111 18.27 19672.36 380928 110 18.81 19309.71 385024 108 18.78 19547.58 389120 107 18.70 19840.76 393216 106 18.99 19742.28 397312 105 19.03 19908.26 401408 104 19.19 19945.74 405504 103 19.62 19713.00 409600 102 19.83 19697.88 413696 101 19.97 19758.03 417792 100 20.13 19788.85 421888 99 20.22 19898.48 425984 98 20.38 19936.21 430080 97 20.80 19722.38 434176 96 21.08 19642.27 438272 95 21.17 19741.98 442368 94 21.55 19579.80 446464 93 21.66 19654.98 450560 93 21.85 19663.11 454656 92 21.96 19744.32 458752 91 22.58 19371.89 462848 90 22.60 19529.45 466944 89 22.90 19444.62 471040 89 23.23 19339.20 475136 88 23.46 19317.15 479232 87 23.70 19286.77 483328 86 24.17 19069.25 487424 86 24.42 19034.38 491520 85 25.05 18709.90 495616 84 25.49 18546.27 499712 83 25.45 18725.10 503808 83 25.85 18589.05 507904 82 26.06 18584.62 512000 81 26.43 18477.17 516096 81 26.77 18383.37 520192 80 27.09 18312.59 524288 80 27.72 18038.08 528384 79 27.97 18017.63 532480 78 28.07 18093.42 536576 78 28.40 18018.70 540672 77 28.91 17837.08 544768 76 29.29 17738.80 548864 76 29.51 17739.17 552960 75 30.15 17493.20 557056 75 30.36 17497.31 561152 74 30.95 17291.38 565248 74 31.09 17338.18 569344 73 31.44 17272.57 573440 73 31.82 17186.13 577536 72 32.18 17117.46 581632 72 32.83 16894.61 585728 71 37.65 14835.17 589824 71 33.23 16925.33 593920 70 33.53 16893.30 598016 70 33.91 16816.76 602112 69 34.05 16864.51 606208 69 34.61 16704.61 610304 68 34.71 16767.95 614400 68 35.36 16569.19 618496 67 35.49 16618.90 622592 67 35.68 16638.88 626688 66 36.06 16574.40 630784 66 36.50 16482.92 634880 66 36.83 16440.25 638976 65 36.89 16520.86 643072 65 37.30 16443.62 647168 64 37.85 16306.60 651264 64 37.93 16375.95 655360 64 38.02 16440.19 659456 63 38.43 16364.64 663552 63 38.58 16401.68 667648 62 39.17 16253.73 671744 62 39.44 16243.42 675840 62 39.90 16153.46 679936 61 40.02 16201.60 684032 61 40.47 16118.19 688128 60 40.93 16032.49 692224 60 41.17 16032.98 696320 60 41.46 16016.56 700416 59 41.88 15949.26 704512 59 42.09 15962.45 708608 59 42.39 15940.47 712704 58 42.64 15941.70 716800 58 43.18 15830.33 720896 58 43.65 15749.87 724992 57 43.95 15732.20 729088 57 44.61 15585.23 733184 57 45.25 15454.00 737280 56 45.43 15476.59 741376 56 46.24 15288.92 745472 56 46.59 15258.20 749568 55 47.07 15187.42 753664 55 47.28 15200.41 757760 55 47.80 15119.46 761856 55 48.17 15083.54 765952 54 48.46 15073.40 770048 54 52.46 13999.69 774144 54 52.72 14004.62 778240 53 50.90 14581.25 782336 53 49.88 14956.73 786432 53 50.17 14948.77 790528 53 50.72 14862.71 794624 52 51.27 14781.06 798720 52 53.51 14234.75 802816 52 54.42 14067.88 806912 51 54.41 14144.19 811008 51 52.39 14762.70 815104 51 52.84 14712.55 819200 51 53.19 14687.71 823296 50 53.76 14605.22 827392 50 54.14 14575.74 831488 50 54.66 14507.34 835584 50 54.94 14504.15 839680 49 55.19 14510.43 843776 49 55.60 14472.75 847872 49 56.13 14406.84 851968 49 56.27 14438.89 856064 48 56.66 14409.07 860160 48 57.50 14266.65 864256 48 57.70 14285.22 868352 48 58.17 14236.49 872448 48 58.53 14215.04 876544 47 58.99 14170.63 880640 47 59.59 14093.84 884736 47 60.12 14035.13 888832 47 60.74 13955.27 892928 46 60.90 13982.87 897024 46 61.44 13922.60 901120 46 61.82 13900.58 905216 46 62.27 13862.65 909312 46 62.72 13825.27 913408 45 63.11 13802.34 917504 45 63.66 13744.23 921600 45 64.03 13726.77 925696 45 64.42 13704.99 929792 45 64.95 13653.33 933888 44 65.38 13622.10 937984 44 65.94 13564.93 942080 44 66.29 13552.89 946176 44 66.87 13493.80 950272 44 67.28 13469.27 954368 43 67.75 13434.10 958464 43 68.23 13397.47 962560 43 68.66 13369.97 966656 43 69.34 13294.81 970752 43 69.57 13306.45 974848 43 69.98 13285.31 978944 42 70.78 13190.78 983040 42 70.92 13219.46 987136 42 71.68 13132.63 991232 42 71.89 13149.63 995328 42 72.81 13036.18 999424 41 73.05 13047.73 1003520 41 73.64 12995.68 1007616 41 73.95 12994.34 1011712 41 74.79 12901.08 1015808 41 75.33 12859.32 1019904 41 76.18 12767.29 1024000 40 76.96 12689.95 1028096 40 77.52 12647.65 1032192 40 77.66 12674.65 1036288 40 78.68 12561.07 1040384 40 79.04 12553.65 1044480 40 79.85 12474.20 1048576 40 80.25 12460.80 #----------------------------------------------------------------------------- # Benchmarking Sendrecv # #processes = 12 #----------------------------------------------------------------------------- #bytes #repetitions t_min[usec] t_max[usec] t_avg[usec] Mbytes/sec 0 1000 0.49 0.50 0.49 0.00 4096 1000 1.76 1.76 1.76 4442.52 8192 1000 3.10 3.10 3.10 5037.74 12288 1000 4.06 4.07 4.06 5759.55 16384 1000 4.85 4.87 4.86 6414.41 20480 1000 4.24 4.24 4.24 9205.53 24576 1000 4.94 4.95 4.95 9461.41 28672 1000 5.34 5.35 5.35 10213.10 32768 1000 5.12 5.13 5.12 12182.54 36864 1000 5.78 5.78 5.78 12160.82 40960 1000 6.09 6.10 6.10 12806.50 45056 930 6.03 6.05 6.04 14212.53 49152 853 6.62 6.64 6.63 14118.50 53248 787 7.18 7.20 7.19 14101.51 57344 731 6.95 6.98 6.97 15662.40 61440 682 7.53 7.55 7.54 15517.85 65536 640 8.03 8.05 8.04 15525.12 69632 602 7.95 7.99 7.97 16616.18 73728 568 9.16 9.20 9.18 15281.67 77824 538 8.82 8.86 8.83 16761.97 81920 512 9.85 9.91 9.88 15773.25 86016 487 9.66 9.69 9.68 16932.01 90112 465 9.84 9.89 9.87 17374.14 94208 445 9.90 9.95 9.93 18058.39 98304 426 10.89 10.95 10.92 17122.56 102400 409 11.09 11.14 11.11 17536.52 106496 393 11.25 11.33 11.29 17928.97 110592 379 12.31 12.37 12.34 17058.30 114688 365 12.28 12.37 12.33 17679.70 118784 353 12.34 12.41 12.38 18257.55 122880 341 14.88 15.00 14.94 15628.54 126976 330 13.61 13.72 13.67 17653.20 131072 320 13.73 13.83 13.78 18079.87 135168 310 15.25 15.39 15.32 16754.97 139264 301 14.83 14.96 14.90 17751.72 143360 292 13.64 13.77 13.71 19861.75 147456 284 15.90 16.00 15.95 17576.20 151552 276 15.89 16.05 15.98 18012.96 155648 269 14.96 15.07 15.02 19696.25 159744 262 17.45 17.62 17.55 17292.81 163840 256 17.16 17.34 17.25 18024.51 167936 249 16.03 16.20 16.12 19772.36 172032 243 18.71 18.92 18.82 17344.17 176128 238 18.11 18.27 18.20 18388.32 180224 232 16.87 16.96 16.92 20272.47 184320 227 19.66 19.91 19.79 17658.94 188416 222 19.72 19.96 19.85 18000.37 192512 217 17.99 18.22 18.11 20149.57 196608 213 20.38 20.58 20.49 18223.46 200704 208 20.63 20.90 20.77 18315.86 204800 204 19.07 19.33 19.20 20211.26 208896 200 22.19 22.50 22.34 17710.56 212992 196 21.98 22.28 22.13 18236.85 217088 193 20.17 20.34 20.25 20352.41 221184 189 23.26 23.51 23.41 17941.53 225280 186 22.94 23.26 23.10 18474.33 229376 182 21.68 22.00 21.84 19883.99 233472 179 23.83 24.18 24.01 18418.46 237568 176 25.40 25.81 25.61 17558.83 241664 173 22.28 22.43 22.36 20551.98 245760 170 26.47 26.97 26.73 17380.84 249856 167 25.55 25.78 25.67 18485.30 253952 165 22.31 22.53 22.43 21495.14 258048 162 25.99 26.44 26.22 18613.58 262144 160 26.24 26.49 26.38 18874.13 266240 157 23.90 24.14 24.01 21037.90 270336 155 27.83 28.19 28.02 18287.87 274432 152 27.31 27.81 27.56 18822.79 278528 150 24.62 25.06 24.85 21198.30 282624 148 28.52 28.82 28.70 18701.55 286720 146 28.88 29.42 29.16 18591.52 290816 144 26.48 26.91 26.68 20614.08 294912 142 30.10 30.69 30.42 18328.14 299008 140 30.09 30.66 30.38 18602.88 303104 138 26.27 26.56 26.45 21768.59 307200 136 30.72 31.31 31.03 18711.99 311296 134 30.55 31.09 30.83 19097.48 315392 132 28.06 28.29 28.17 21262.38 319488 131 32.57 33.27 32.93 18317.38 323584 129 32.83 33.52 33.18 18414.04 327680 128 29.10 29.47 29.26 21210.13 331776 126 31.69 32.11 31.88 19710.63 335872 124 32.94 33.45 33.26 19150.77 339968 123 29.24 29.63 29.44 21883.20 344064 121 33.64 34.40 34.03 19078.53 348160 120 33.98 34.65 34.33 19163.67 352256 119 30.42 31.09 30.76 21608.85 356352 117 37.08 37.98 37.54 17895.99 360448 116 35.28 36.14 35.71 19022.73 364544 115 31.82 32.30 32.12 21527.73 368640 113 35.98 36.48 36.28 19271.95 372736 112 35.38 36.32 35.86 19575.14 376832 111 33.26 33.75 33.51 21296.18 380928 110 37.43 38.11 37.86 19064.81 385024 108 37.26 38.21 37.75 19220.06 389120 107 35.09 35.46 35.28 20929.11 393216 106 39.10 40.12 39.63 18696.22 397312 105 39.32 40.38 39.87 18765.37 401408 104 37.29 37.71 37.51 20302.22 405504 103 40.66 41.76 41.21 18519.86 409600 102 40.31 41.23 40.83 18949.63 413696 101 37.32 38.17 37.72 20672.01 417792 100 42.46 43.64 43.08 18258.14 421888 99 41.09 42.05 41.66 19138.28 425984 98 39.41 40.52 39.97 20049.92 430080 97 42.97 43.98 43.46 18652.10 434176 96 42.65 43.92 43.36 18855.87 438272 95 41.32 41.82 41.57 19987.20 442368 94 44.28 45.14 44.76 18691.96 446464 93 44.17 45.48 44.84 18723.25 450560 93 42.66 43.89 43.27 19580.41 454656 92 45.73 46.57 46.16 18621.41 458752 91 45.88 47.26 46.58 18514.88 462848 90 42.99 44.26 43.64 19946.76 466944 89 46.75 48.24 47.52 18461.00 471040 89 47.34 48.81 48.09 18406.26 475136 88 45.00 46.33 45.68 19562.30 479232 87 48.29 49.50 48.90 18467.72 483328 86 48.36 49.93 49.16 18464.64 487424 86 46.77 48.19 47.49 19290.60 491520 85 49.64 51.26 50.48 18289.12 495616 84 49.73 51.33 50.57 18418.07 499712 83 48.57 50.09 49.35 19029.01 503808 83 50.70 52.07 51.49 18453.69 507904 82 52.08 53.21 52.79 18207.83 512000 81 50.52 52.12 51.33 18737.00 516096 81 58.22 60.33 59.31 16316.06 520192 80 55.11 57.01 56.08 17402.27 524288 80 52.28 53.60 53.11 18657.94 528384 79 57.56 59.65 58.62 16896.31 532480 78 55.45 57.44 56.46 17682.27 536576 78 54.52 56.31 55.44 18175.19 540672 77 56.62 58.68 57.70 17575.41 544768 76 58.64 60.74 59.71 17106.65 548864 76 56.75 57.73 57.38 18133.42 552960 75 57.76 59.08 58.29 17851.82 557056 75 60.35 62.55 61.47 16986.87 561152 74 56.38 57.90 57.24 18484.42 565248 74 60.40 62.53 61.70 17240.81 569344 73 62.81 65.13 63.98 16672.36 573440 73 60.05 61.87 60.99 17676.90 577536 72 63.13 65.65 64.44 16778.17 581632 72 64.11 66.54 65.34 16672.64 585728 71 61.60 62.94 62.37 17751.23 589824 71 64.37 66.33 65.33 16960.46 593920 70 66.03 68.62 67.35 16507.60 598016 70 62.63 64.56 63.69 17668.51 602112 69 72.72 75.92 74.39 15127.48 606208 69 67.39 70.11 68.78 16491.39 610304 68 65.62 67.14 66.55 17337.10 614400 68 73.72 76.92 75.35 15234.68 618496 67 69.45 72.33 70.91 16309.84 622592 67 67.37 69.02 68.33 17204.17 626688 66 70.39 72.82 71.45 16414.07 630784 66 72.05 75.05 73.58 16029.93 634880 66 69.38 71.16 70.35 17017.80 638976 65 74.75 77.21 75.95 15784.68 643072 65 73.98 76.46 75.07 16042.09 647168 64 71.72 73.44 72.80 16807.85 651264 64 78.13 80.72 79.55 15389.63 655360 64 75.14 77.66 76.32 16095.57 659456 63 73.25 74.55 73.90 16871.36 663552 63 84.77 88.78 86.85 14255.34 667648 62 78.11 81.75 79.93 15576.36 671744 62 74.80 76.76 75.90 16692.64 675840 62 80.86 84.48 82.75 15257.93 679936 61 80.46 83.35 81.75 15559.61 684032 61 77.37 80.41 78.90 16226.31 688128 60 80.44 84.34 82.56 15561.17 692224 60 84.28 87.32 85.57 15120.25 696320 60 82.22 85.27 83.88 15575.45 700416 59 88.50 92.96 90.80 14371.26 704512 59 86.75 91.00 88.87 14765.97 708608 59 83.95 88.15 86.14 15333.19 712704 58 89.49 91.65 90.66 14832.68 716800 58 87.91 91.17 89.30 14996.63 720896 58 84.85 88.89 86.93 15468.73 724992 57 90.31 93.70 91.79 14758.11 729088 57 90.62 94.15 92.14 14770.28 733184 57 86.14 88.62 87.52 15780.79 737280 56 92.29 97.04 94.80 14491.35 741376 56 92.86 96.38 94.40 14672.28 745472 56 88.44 92.72 90.66 15335.97 749568 55 95.94 99.77 97.61 14330.22 753664 55 94.08 97.80 95.78 14698.47 757760 55 92.33 96.93 94.66 14910.53 761856 55 97.83 101.52 99.51 14313.88 765952 54 96.86 100.69 98.59 14509.59 770048 54 95.61 99.52 97.38 14758.68 774144 54 99.59 103.42 101.44 14277.25 778240 53 99.64 103.26 101.24 14375.44 782336 53 94.86 98.47 97.13 15154.21 786432 53 102.02 106.11 104.16 14136.31 790528 53 102.37 106.21 104.33 14196.09 794624 52 100.19 104.53 102.24 14499.67 798720 52 104.12 108.44 106.34 14048.18 802816 52 105.00 108.78 106.65 14076.77 806912 51 103.02 106.29 104.56 14480.12 811008 51 106.34 110.86 108.54 13953.41 815104 51 108.19 112.70 110.26 13794.69 819200 51 104.82 108.14 106.64 14448.97 823296 50 109.41 113.41 111.37 13846.22 827392 50 110.12 113.73 112.14 13876.01 831488 50 108.87 112.37 110.48 14113.95 835584 50 112.00 116.50 114.33 13680.16 839680 49 112.82 117.02 114.64 13685.69 843776 49 111.21 116.03 113.33 13870.10 847872 49 114.94 119.89 117.64 13488.87 851968 49 115.00 118.85 116.58 13672.79 856064 48 113.61 116.61 115.13 14002.75 860160 48 117.30 122.28 120.51 13416.53 864256 48 116.89 121.69 119.05 13546.44 868352 48 116.40 118.98 117.73 13920.89 872448 48 119.65 124.04 121.72 13415.83 876544 47 119.69 125.36 122.29 13336.32 880640 47 117.94 124.85 121.42 13454.17 884736 47 121.13 126.24 123.51 13367.38 888832 47 122.24 127.79 125.00 13266.15 892928 46 122.31 128.13 124.86 13291.70 897024 46 126.09 134.03 130.31 12765.07 901120 46 125.11 130.59 127.58 13161.82 905216 46 126.41 131.14 128.31 13165.74 909312 46 128.66 134.66 131.69 12879.67 913408 45 128.17 134.44 131.05 12958.69 917504 45 126.93 130.82 128.93 13377.40 921600 45 129.16 133.80 132.02 13138.08 925696 45 132.31 138.84 135.17 12716.57 929792 45 130.48 134.92 132.49 13144.52 933888 44 134.10 140.80 137.47 12651.19 937984 44 135.34 140.24 138.01 12756.76 942080 44 133.51 138.52 135.88 12971.84 946176 44 137.76 144.55 141.08 12484.69 950272 44 136.20 142.86 139.82 12687.11 954368 43 136.20 141.35 138.66 12878.15 958464 43 139.71 146.58 143.09 12472.07 962560 43 139.02 145.39 141.87 12627.59 966656 43 138.90 144.09 141.40 12796.00 970752 43 145.41 151.28 147.96 12238.91 974848 43 145.10 148.75 146.88 12500.38 978944 42 141.51 146.87 144.12 12713.56 983040 42 145.99 156.20 151.42 12003.98 987136 42 146.78 154.47 150.28 12189.10 991232 42 144.97 150.60 148.08 12553.86 995328 42 153.14 161.43 158.41 11760.39 999424 41 148.10 154.41 150.76 12345.07 1003520 41 147.57 154.37 150.84 12399.40 1007616 41 153.13 161.43 157.55 11905.55 1011712 41 152.16 158.14 155.63 12202.75 1015808 41 152.07 160.46 156.18 12074.55 1019904 41 157.78 166.27 161.94 11699.66 1024000 40 154.94 159.72 157.99 12228.69 1028096 40 153.54 164.14 158.86 11946.79 1032192 40 160.97 167.31 164.14 11767.06 1036288 40 155.97 161.78 159.32 12217.23 1040384 40 159.69 166.21 162.91 11939.14 1044480 40 161.10 169.98 166.35 11720.09 1048576 40 160.78 165.92 163.39 12054.33 #----------------------------------------------------------------------------- # Benchmarking Exchange # #processes = 12 #----------------------------------------------------------------------------- #bytes #repetitions t_min[usec] t_max[usec] t_avg[usec] Mbytes/sec 0 1000 1.14 1.15 1.15 0.00 4096 1000 4.39 4.40 4.39 3550.35 8192 1000 6.24 6.25 6.25 4999.89 12288 1000 6.92 6.92 6.92 6769.08 16384 1000 7.30 7.30 7.30 8560.92 20480 1000 7.45 7.46 7.46 10468.01 24576 1000 7.99 7.99 7.99 11727.29 28672 1000 8.23 8.24 8.23 13278.30 32768 1000 8.69 8.70 8.70 14367.20 36864 1000 8.97 8.98 8.97 15665.14 40960 1000 9.71 9.72 9.72 16072.99 45056 930 9.79 9.80 9.79 17540.51 49152 853 10.50 10.51 10.51 17835.91 53248 787 10.91 10.93 10.92 18584.70 57344 731 11.25 11.26 11.26 19419.06 61440 682 11.59 11.60 11.59 20202.29 65536 640 11.93 11.95 11.94 20913.35 69632 602 12.50 12.53 12.52 21206.42 73728 568 12.93 12.95 12.94 21716.47 77824 538 13.59 13.61 13.60 21813.32 81920 512 13.55 13.57 13.56 23020.33 86016 487 13.86 13.89 13.87 23619.84 90112 465 14.50 14.52 14.51 23675.16 94208 445 15.94 15.96 15.95 22512.53 98304 426 15.84 15.87 15.86 23626.24 102400 409 16.96 16.98 16.97 23000.81 106496 393 16.71 16.76 16.74 24236.22 110592 379 16.17 16.20 16.19 26034.78 114688 365 18.50 18.55 18.53 23582.07 118784 353 19.07 19.13 19.10 23682.16 122880 341 19.31 19.38 19.34 24181.54 126976 330 19.78 19.88 19.83 24369.64 131072 320 21.58 21.67 21.63 23076.53 135168 310 21.17 21.26 21.21 24257.66 139264 301 21.89 21.97 21.94 24176.17 143360 292 21.74 21.82 21.78 25068.42 147456 284 22.21 22.28 22.25 25251.18 151552 276 22.48 22.55 22.52 25636.99 155648 269 22.77 22.83 22.80 26006.79 159744 262 23.27 23.35 23.31 26095.90 163840 256 24.62 24.77 24.70 25230.79 167936 249 23.59 23.67 23.63 27069.79 172032 243 24.23 24.36 24.30 26940.85 176128 238 25.28 25.44 25.37 26412.61 180224 232 26.03 26.18 26.12 26264.83 184320 227 27.06 27.17 27.11 25882.48 188416 222 27.88 27.98 27.93 25687.17 192512 217 27.47 27.59 27.53 26617.88 196608 213 28.12 28.26 28.18 26535.19 200704 208 29.47 29.61 29.55 25854.19 204800 204 28.68 28.82 28.73 27105.15 208896 200 29.44 29.61 29.54 26916.34 212992 196 28.23 28.35 28.28 28656.01 217088 193 30.26 30.43 30.34 27212.01 221184 189 29.83 30.00 29.92 28127.01 225280 186 29.91 30.05 29.99 28600.88 229376 182 31.14 31.34 31.23 27918.20 233472 179 28.65 28.79 28.73 30939.47 237568 176 27.61 27.65 27.63 32779.24 241664 173 31.23 31.37 31.29 29386.55 245760 170 30.71 30.77 30.74 30469.36 249856 167 30.22 30.29 30.26 31463.09 253952 165 29.91 29.97 29.94 32327.17 258048 162 30.84 30.87 30.86 31886.94 262144 160 34.73 34.93 34.87 28632.50 266240 157 32.43 32.49 32.46 31255.02 270336 155 34.57 34.64 34.61 29771.89 274432 152 34.91 35.01 34.95 29898.25 278528 150 36.06 36.20 36.15 29348.34 282624 148 36.10 36.32 36.23 29683.92 286720 146 37.58 37.65 37.63 29047.53 290816 144 34.96 35.05 35.01 31653.44 294912 142 35.99 36.06 36.03 31199.48 299008 140 36.61 36.97 36.84 30849.70 303104 138 40.21 40.50 40.33 28546.90 307200 136 37.35 37.45 37.40 31293.82 311296 134 37.92 38.02 37.97 31230.11 315392 132 38.79 38.87 38.83 30950.09 319488 131 39.49 39.61 39.55 30767.14 323584 129 41.08 41.21 41.14 29953.69 327680 128 44.18 44.39 44.30 28159.14 331776 126 42.66 42.80 42.73 29568.12 335872 124 42.09 42.23 42.16 30337.81 339968 123 45.27 45.39 45.33 28568.98 344064 121 45.57 45.69 45.63 28725.17 348160 120 45.09 45.22 45.16 29368.97 352256 119 47.34 47.48 47.41 28299.38 356352 117 50.58 50.76 50.68 26777.90 360448 116 50.82 50.92 50.87 27002.68 364544 115 53.21 53.46 53.32 26010.58 368640 113 54.82 55.16 54.98 25493.46 372736 112 56.32 56.77 56.60 25047.55 376832 111 56.43 56.77 56.62 25323.66 380928 110 55.18 55.33 55.25 26263.69 385024 108 55.39 55.84 55.60 26302.49 389120 107 58.39 58.82 58.59 25233.84 393216 106 60.36 60.77 60.53 24682.42 397312 105 61.14 61.68 61.41 24571.48 401408 104 60.77 61.20 61.04 25019.40 405504 103 60.96 61.27 61.10 25246.34 409600 102 63.01 63.32 63.20 24674.88 413696 101 64.35 64.73 64.60 24380.32 417792 100 65.63 65.89 65.79 24188.28 421888 99 65.13 65.66 65.43 24512.00 425984 98 67.39 67.89 67.74 23937.17 430080 97 68.24 68.54 68.41 23937.03 434176 96 69.10 69.22 69.16 23926.18 438272 95 69.16 69.43 69.31 24080.88 442368 94 72.26 72.64 72.41 23232.12 446464 93 73.04 73.29 73.15 23238.37 450560 93 74.07 74.50 74.34 23069.86 454656 92 75.22 75.61 75.39 22936.93 458752 91 73.02 73.25 73.12 23890.94 462848 90 75.95 76.26 76.13 23151.24 466944 89 74.46 74.78 74.63 23818.89 471040 89 77.38 77.71 77.53 23124.11 475136 88 78.53 78.79 78.70 23003.63 479232 87 78.52 78.74 78.64 23216.89 483328 86 80.69 81.03 80.87 22752.63 487424 86 85.42 85.61 85.51 21718.00 491520 85 80.62 80.81 80.71 23203.42 495616 84 82.02 82.35 82.18 22959.74 499712 83 82.50 82.97 82.80 22974.47 503808 83 85.26 85.63 85.45 22443.29 507904 82 87.14 87.57 87.38 22125.31 512000 81 87.99 88.43 88.19 22086.74 516096 81 87.84 88.11 87.96 22345.25 520192 80 93.00 93.19 93.11 21292.76 524288 80 92.44 92.86 92.70 21536.86 528384 79 93.38 93.72 93.59 21506.28 532480 78 94.40 94.72 94.57 21444.22 536576 78 95.30 95.75 95.59 21376.71 540672 77 97.03 97.50 97.23 21153.00 544768 76 96.86 97.22 97.07 21374.48 548864 76 97.58 97.92 97.77 21382.03 552960 75 98.72 99.18 98.98 21269.06 557056 75 99.46 99.83 99.69 21286.73 561152 74 101.12 101.61 101.42 21066.11 565248 74 101.79 102.13 101.98 21112.10 569344 73 102.36 102.76 102.59 21135.07 573440 73 105.55 106.00 105.83 20637.13 577536 72 105.40 105.77 105.62 20829.70 581632 72 106.79 107.21 107.02 20695.58 585728 71 112.36 112.86 112.65 19797.88 589824 71 108.72 109.18 108.97 20609.01 593920 70 112.78 114.38 113.65 19808.53 598016 70 111.77 112.26 112.03 20321.55 602112 69 113.11 113.59 113.38 20220.59 606208 69 112.81 113.26 113.05 20417.77 610304 68 113.34 113.76 113.56 20465.73 614400 68 114.13 114.58 114.39 20455.56 618496 67 116.64 117.00 116.82 20166.30 622592 67 116.42 116.95 116.72 20307.88 626688 66 117.73 118.26 118.04 20214.51 630784 66 118.63 119.03 118.80 20215.72 634880 66 119.86 120.34 120.13 20125.27 638976 65 120.51 120.94 120.72 20154.53 643072 65 121.67 122.13 121.92 20086.95 647168 64 122.72 123.13 122.93 20050.22 651264 64 123.77 124.35 124.06 19978.86 655360 64 124.32 124.76 124.55 20039.08 659456 63 125.74 126.23 126.03 19929.00 663552 63 126.67 127.04 126.83 19924.35 667648 62 127.50 127.92 127.70 19910.02 671744 62 128.27 128.76 128.48 19901.15 675840 62 129.35 129.81 129.58 19861.16 679936 61 130.58 131.00 130.79 19800.02 684032 61 132.00 132.47 132.18 19698.31 688128 60 132.45 132.91 132.64 19750.74 692224 60 133.57 134.11 133.81 19690.51 696320 60 134.31 134.81 134.54 19704.27 700416 59 134.79 135.28 135.00 19751.25 704512 59 136.61 137.15 136.91 19595.73 708608 59 138.25 138.80 138.56 19474.96 712704 58 139.18 139.71 139.45 19459.49 716800 58 140.31 140.85 140.55 19413.68 720896 58 146.27 147.82 147.03 18604.29 724992 57 146.94 148.04 147.42 18681.98 729088 57 142.76 143.55 143.06 19374.37 733184 57 153.29 154.84 154.06 18062.72 737280 56 144.92 145.87 145.36 19281.48 741376 56 148.19 150.70 149.44 18766.36 745472 56 146.70 147.44 146.99 19287.43 749568 55 148.59 149.25 148.89 19158.84 753664 55 148.98 149.89 149.41 19180.53 757760 55 150.90 151.56 151.22 19072.41 761856 55 150.38 151.06 150.65 19238.79 765952 54 152.08 152.91 152.44 19108.44 770048 54 156.87 158.30 157.57 18556.93 774144 54 154.57 155.57 155.06 18982.30 778240 53 155.89 156.50 156.18 18970.01 782336 53 166.71 168.04 167.34 17759.90 786432 53 158.53 159.24 158.90 18839.89 790528 53 159.02 160.20 159.64 18823.68 794624 52 160.00 160.54 160.27 18881.26 798720 52 160.57 161.78 161.27 18833.36 802816 52 161.53 162.31 161.92 18868.44 806912 51 162.45 163.13 162.72 18869.73 811008 51 163.38 164.14 163.75 18848.30 815104 51 164.34 165.37 164.85 18802.65 819200 51 168.86 169.55 169.25 18430.81 823296 50 167.07 167.69 167.36 18728.30 827392 50 169.27 171.12 170.19 18444.90 831488 50 170.13 170.78 170.47 18572.44 835584 50 169.76 170.32 170.00 18714.61 839680 49 170.70 171.56 171.18 18670.67 843776 49 172.92 173.70 173.28 18530.50 847872 49 173.16 173.99 173.54 18589.21 851968 49 174.47 177.04 175.78 18357.14 856064 48 175.97 178.66 177.28 18278.44 860160 48 176.27 177.39 176.88 18497.55 864256 48 177.35 178.60 177.97 18459.51 868352 48 177.40 178.59 178.00 18548.54 872448 48 178.58 179.55 179.01 18536.02 876544 47 179.67 180.57 180.09 18517.32 880640 47 182.20 183.83 182.89 18274.77 884736 47 181.55 182.47 181.97 18496.57 888832 47 182.19 183.07 182.58 18520.93 892928 46 183.50 184.36 183.96 18476.10 897024 46 184.78 185.54 185.17 18442.64 901120 46 185.60 186.47 186.05 18434.16 905216 46 186.60 187.47 187.09 18419.66 909312 46 187.45 188.25 187.83 18426.08 913408 45 189.63 190.51 190.02 18290.01 917504 45 190.35 191.04 190.71 18321.07 921600 45 190.92 191.78 191.27 18331.68 925696 45 192.01 192.81 192.44 18315.00 929792 45 193.03 193.96 193.45 18286.99 933888 44 194.02 194.86 194.36 18282.00 937984 44 195.23 196.37 195.81 18221.32 942080 44 195.70 197.01 196.39 18241.50 946176 44 196.57 197.44 196.94 18280.58 950272 44 198.33 199.12 198.72 18204.84 954368 43 198.25 199.23 198.67 18273.55 958464 43 199.37 200.27 199.73 18256.96 962560 43 200.74 201.76 201.19 18198.94 966656 43 201.90 202.65 202.26 18196.38 970752 43 202.91 203.77 203.30 18173.04 974848 43 203.66 204.82 204.29 18155.85 978944 42 205.34 206.27 205.75 18104.64 983040 42 205.57 206.58 205.97 18152.92 987136 42 206.03 207.00 206.42 18191.56 991232 42 207.45 208.44 207.99 18140.69 995328 42 208.74 209.85 209.18 18092.96 999424 41 209.34 210.40 209.77 18120.12 1003520 41 210.30 211.30 210.80 18116.77 1007616 41 210.88 211.87 211.32 18141.79 1011712 41 211.95 213.01 212.48 18118.57 1015808 41 212.59 213.58 213.10 18143.38 1019904 41 213.04 213.82 213.53 18195.73 1024000 40 214.52 215.65 215.09 18113.88 1028096 40 216.07 217.21 216.78 18056.08 1032192 40 216.91 217.94 217.44 18066.54 1036288 40 218.79 219.73 219.28 17990.62 1040384 40 219.29 220.38 219.83 18008.97 1044480 40 220.20 221.20 220.75 18012.16 1048576 40 222.08 222.92 222.41 17944.03 #---------------------------------------------------------------- # Benchmarking Allreduce # #processes = 12 #---------------------------------------------------------------- #bytes #repetitions t_min[usec] t_max[usec] t_avg[usec] 0 1000 0.08 0.09 0.09 4096 1000 11.48 11.49 11.49 8192 1000 20.74 20.75 20.74 12288 1000 32.15 32.16 32.15 16384 1000 37.63 37.64 37.64 20480 1000 47.60 47.62 47.61 24576 1000 51.74 51.76 51.75 28672 1000 57.09 57.10 57.09 32768 1000 44.25 44.25 44.25 36864 1000 41.04 41.04 41.04 40960 1000 47.45 47.46 47.45 45056 930 52.26 52.26 52.26 49152 853 50.51 50.51 50.51 53248 787 54.10 54.11 54.11 57344 731 60.27 60.27 60.27 61440 682 113.74 113.76 113.75 65536 640 115.54 115.54 115.54 69632 602 116.69 116.69 116.69 73728 568 123.49 123.53 123.51 77824 538 124.80 124.80 124.80 81920 512 124.49 124.49 124.49 86016 487 135.45 135.49 135.47 90112 465 126.68 126.69 126.68 94208 445 129.74 129.74 129.74 98304 426 147.41 147.46 147.44 102400 409 140.40 140.40 140.40 106496 393 142.32 142.32 142.32 110592 379 161.65 161.71 161.68 114688 365 152.35 152.35 152.35 118784 353 152.86 152.87 152.87 122880 341 171.26 171.34 171.30 126976 330 160.41 160.42 160.41 131072 320 188.86 188.99 188.93 135168 310 185.64 185.83 185.75 139264 301 194.21 194.42 194.33 143360 292 205.55 205.73 205.64 147456 284 211.17 211.40 211.30 151552 276 215.91 216.14 216.04 155648 269 221.41 221.66 221.54 159744 262 227.67 227.93 227.81 163840 256 234.03 234.30 234.18 167936 249 226.92 227.18 227.05 172032 243 233.94 234.25 234.12 176128 238 241.60 241.92 241.77 180224 232 245.64 245.96 245.82 184320 227 253.78 254.12 253.98 188416 222 263.27 263.64 263.48 192512 217 257.22 257.60 257.43 196608 213 258.43 258.82 258.64 200704 208 265.53 265.94 265.76 204800 204 274.54 274.95 274.77 208896 200 282.35 282.78 282.60 212992 196 283.37 283.81 283.60 217088 193 281.53 281.91 281.71 221184 189 292.36 292.87 292.64 225280 186 301.84 302.35 302.11 229376 182 306.79 307.30 307.08 233472 179 312.53 313.06 312.83 237568 176 319.00 319.48 319.25 241664 173 312.89 313.34 313.11 245760 170 321.10 321.70 321.44 249856 167 332.11 332.74 332.46 253952 165 336.54 337.05 336.79 258048 162 330.88 331.55 331.26 262144 160 334.66 335.30 335.02 266240 157 342.24 342.98 342.64 270336 155 347.92 348.62 348.33 274432 152 356.58 357.29 357.00 278528 150 366.37 367.16 366.82 282624 148 363.50 364.31 363.96 286720 146 367.01 367.78 367.43 290816 144 376.02 376.69 376.36 294912 142 381.75 382.57 382.21 299008 140 391.43 392.33 391.92 303104 138 398.62 399.34 398.99 307200 136 404.16 405.08 404.67 311296 134 402.53 403.36 402.95 315392 132 401.44 402.39 401.95 319488 131 409.91 410.91 410.46 323584 129 419.68 420.48 420.08 327680 128 424.63 425.43 425.02 331776 126 429.95 431.01 430.57 335872 124 436.02 437.08 436.63 339968 123 444.88 445.90 445.40 344064 121 433.57 434.48 434.01 348160 120 450.58 451.75 451.23 352256 119 460.65 461.85 461.31 356352 117 471.17 472.20 471.67 360448 116 476.18 477.47 476.88 364544 115 481.46 482.82 482.21 368640 113 492.32 493.38 492.84 372736 112 497.75 499.16 498.57 376832 111 502.43 503.83 503.22 380928 110 505.25 506.65 506.06 385024 108 510.10 511.58 510.95 389120 107 515.57 517.00 516.40 393216 106 523.65 524.84 524.26 397312 105 529.93 531.48 530.82 401408 104 531.86 533.42 532.71 405504 103 537.08 538.72 538.02 409600 102 529.61 531.38 530.56 413696 101 526.13 527.69 527.03 417792 100 534.11 535.68 534.98 421888 99 536.25 537.85 537.14 425984 98 550.70 552.42 551.67 430080 97 538.43 540.18 539.38 434176 96 548.83 550.26 549.51 438272 95 557.02 558.48 557.75 442368 94 563.01 564.58 563.80 446464 93 576.72 578.74 577.84 450560 93 584.17 586.09 585.23 454656 92 590.01 591.95 591.11 458752 91 594.50 596.08 595.33 462848 90 602.22 604.26 603.39 466944 89 599.61 601.55 600.61 471040 89 601.59 603.55 602.67 475136 88 610.68 612.65 611.76 479232 87 615.16 617.25 616.31 483328 86 619.98 622.22 621.26 487424 86 625.59 627.85 626.91 491520 85 630.96 633.10 632.19 495616 84 633.28 635.45 634.49 499712 83 636.97 639.13 638.18 503808 83 653.43 655.69 654.69 507904 82 659.94 662.29 661.25 512000 81 664.12 666.52 665.50 516096 81 667.68 669.98 669.01 520192 80 672.43 674.89 673.83 524288 80 675.05 677.43 676.43 528384 79 680.64 683.05 682.04 532480 78 682.42 684.86 683.83 536576 78 687.90 690.47 689.39 540672 77 687.39 689.31 688.31 544768 76 682.44 684.91 683.74 548864 76 692.21 694.74 693.66 552960 75 695.44 698.09 696.99 557056 75 699.94 702.62 701.51 561152 74 703.89 706.04 705.01 565248 74 707.41 710.16 709.02 569344 73 713.71 716.65 715.40 573440 73 721.56 724.24 723.03 577536 72 720.37 723.16 721.91 581632 72 726.29 729.24 728.00 585728 71 726.33 729.11 727.78 589824 71 731.44 734.46 733.14 593920 70 737.00 739.27 738.16 598016 70 738.57 741.54 740.30 602112 69 748.51 751.60 750.34 606208 69 753.55 756.73 755.41 610304 68 766.66 769.95 768.55 614400 68 776.45 779.71 778.33 618496 67 776.80 779.92 778.47 622592 67 779.11 782.34 780.82 626688 66 777.76 781.18 779.68 630784 66 783.08 786.60 785.05 634880 66 795.53 798.28 796.87 638976 65 798.91 802.45 800.92 643072 65 802.49 806.05 804.50 647168 64 808.46 812.06 810.50 651264 64 812.35 816.10 814.47 655360 64 815.44 818.83 817.30 659456 63 819.76 823.28 821.76 663552 63 827.83 831.70 830.02 667648 62 837.31 841.21 839.57 671744 62 842.14 846.06 844.29 675840 62 846.42 850.38 848.69 679936 61 851.21 855.05 853.27 684032 61 857.91 861.84 860.11 688128 60 861.90 866.10 864.31 692224 60 866.78 871.00 869.19 696320 60 871.36 875.39 873.50 700416 59 878.62 882.79 880.95 704512 59 883.47 887.80 885.92 708608 59 887.62 892.19 890.26 712704 58 892.89 897.36 895.46 716800 58 898.97 903.35 901.31 720896 58 904.04 908.70 906.69 724992 57 909.52 914.15 912.18 729088 57 913.36 918.04 916.04 733184 57 895.71 900.21 898.14 737280 56 900.14 904.88 902.82 741376 56 908.85 913.59 911.52 745472 56 915.36 920.17 918.06 749568 55 929.73 934.99 932.70 753664 55 937.99 943.09 940.74 757760 55 942.76 947.78 945.61 761856 55 948.33 953.47 951.22 765952 54 953.40 958.69 956.37 770048 54 958.92 964.28 961.97 774144 54 962.55 967.83 965.53 778240 53 967.41 972.84 970.53 782336 53 972.58 977.84 975.60 786432 53 711.91 713.85 712.87 790528 53 668.98 669.02 669.00 794624 52 664.05 664.09 664.06 798720 52 710.29 712.33 711.32 802816 52 650.23 650.25 650.24 806912 51 630.82 630.87 630.85 811008 51 725.58 727.68 726.62 815104 51 645.89 645.91 645.89 819200 51 626.44 626.48 626.46 823296 50 708.18 710.20 709.19 827392 50 658.14 658.16 658.15 831488 50 649.37 649.42 649.39 835584 50 741.32 743.51 742.43 839680 49 646.49 646.53 646.51 843776 49 643.95 643.99 643.97 847872 49 748.73 750.94 749.83 851968 49 648.45 648.49 648.47 856064 48 705.76 705.79 705.78 860160 48 762.15 764.43 763.28 864256 48 713.51 713.53 713.52 868352 48 714.68 714.72 714.71 872448 48 767.53 769.74 768.63 876544 47 721.85 721.89 721.86 880640 47 730.42 730.46 730.44 884736 47 779.72 782.23 780.97 888832 47 736.67 736.70 736.69 892928 46 745.73 745.77 745.75 897024 46 796.12 798.54 797.32 901120 46 743.25 743.29 743.27 905216 46 742.20 742.23 742.21 909312 46 805.10 807.59 806.33 913408 45 748.48 748.50 748.48 917504 45 763.60 763.64 763.62 921600 45 814.46 817.00 815.71 925696 45 764.36 764.39 764.38 929792 45 770.14 770.19 770.16 933888 44 820.85 823.60 822.17 937984 44 770.07 770.10 770.08 942080 44 777.43 777.47 777.45 946176 44 818.18 820.90 819.56 950272 44 755.66 755.69 755.68 954368 43 724.62 724.66 724.64 958464 43 826.76 829.57 828.18 962560 43 723.37 723.41 723.39 966656 43 720.93 720.98 720.95 970752 43 830.32 833.03 831.68 974848 43 731.91 731.96 731.93 978944 42 739.98 740.03 740.01 983040 42 835.75 838.51 837.14 987136 42 739.19 739.25 739.22 991232 42 749.67 749.71 749.69 995328 42 833.03 836.03 834.54 999424 41 750.58 750.64 750.61 1003520 41 770.56 770.62 770.59 1007616 41 875.86 878.96 877.41 1011712 41 756.96 757.01 756.99 1015808 41 764.20 764.24 764.22 1019904 41 865.59 868.56 867.08 1024000 40 772.24 772.29 772.26 1028096 40 778.10 778.15 778.12 1032192 40 863.58 866.60 865.10 1036288 40 837.92 837.95 837.93 1040384 40 846.69 846.74 846.71 1044480 40 907.83 910.96 909.39 1048576 40 853.65 853.68 853.66 #---------------------------------------------------------------- # Benchmarking Reduce # #processes = 12 #---------------------------------------------------------------- #bytes #repetitions t_min[usec] t_max[usec] t_avg[usec] 0 1000 0.09 0.10 0.09 4096 1000 5.74 5.76 5.75 8192 1000 13.07 13.11 13.09 12288 1000 16.55 16.59 16.57 16384 1000 24.92 24.95 24.94 20480 1000 33.10 33.13 33.12 24576 1000 36.07 36.10 36.09 28672 1000 39.03 39.07 39.06 32768 1000 41.28 41.31 41.30 36864 1000 44.15 44.20 44.18 40960 1000 53.89 53.95 53.93 45056 930 56.81 56.88 56.86 49152 853 58.83 58.89 58.87 53248 787 62.60 62.69 62.66 57344 731 66.04 66.11 66.09 61440 682 68.99 69.07 69.04 65536 640 72.98 73.21 73.11 69632 602 78.16 78.38 78.27 73728 568 82.10 82.39 82.26 77824 538 85.68 86.00 85.86 81920 512 89.80 90.12 89.97 86016 487 93.18 93.48 93.32 90112 465 97.02 97.43 97.24 94208 445 100.50 100.86 100.67 98304 426 104.38 104.77 104.57 102400 409 107.64 108.06 107.84 106496 393 112.00 112.58 112.32 110592 379 115.80 116.29 116.03 114688 365 120.88 121.44 121.17 118784 353 123.38 123.96 123.68 122880 341 125.91 126.54 126.24 126976 330 129.80 130.43 130.09 131072 320 133.88 134.64 134.26 135168 310 138.09 138.97 138.57 139264 301 142.37 143.13 142.73 143360 292 146.34 147.35 146.89 147456 284 151.20 152.18 151.71 151552 276 154.99 155.92 155.43 155648 269 159.53 160.60 160.11 159744 262 164.63 165.87 165.30 163840 256 168.33 169.70 169.06 167936 249 172.21 173.61 172.95 172032 243 176.22 177.66 177.00 176128 238 179.99 181.49 180.80 180224 232 185.25 186.87 186.13 184320 227 188.83 190.26 189.59 188416 222 193.05 194.54 193.77 192512 217 196.69 198.18 197.40 196608 213 200.25 202.18 201.28 200704 208 203.34 205.35 204.43 204800 204 208.44 210.14 209.25 208896 200 212.81 214.76 213.83 212992 196 216.36 218.63 217.61 217088 193 218.12 219.97 219.01 221184 189 220.07 222.38 221.30 225280 186 224.37 226.42 225.36 229376 182 227.81 230.07 228.99 233472 179 231.50 233.81 232.67 237568 176 236.61 239.00 237.84 241664 173 240.61 243.11 241.94 245760 170 243.95 246.50 245.28 249856 167 247.23 249.74 248.53 253952 165 251.85 254.94 253.51 258048 162 256.74 259.48 258.11 262144 160 258.92 262.33 260.78 266240 157 263.12 265.78 264.38 270336 155 266.94 269.93 268.51 274432 152 270.80 273.96 272.42 278528 150 275.68 278.84 277.23 282624 148 279.16 283.05 281.27 286720 146 282.33 285.80 284.14 290816 144 287.00 290.32 288.64 294912 142 290.42 294.49 292.62 299008 140 294.11 297.92 296.08 303104 138 298.39 302.18 300.27 307200 136 301.53 306.18 304.05 311296 134 304.98 309.13 307.15 315392 132 308.75 312.83 310.73 319488 131 309.97 314.10 312.14 323584 129 312.79 317.65 315.39 327680 128 318.08 322.61 320.40 331776 126 321.59 326.03 323.79 335872 124 325.17 330.67 328.17 339968 123 327.76 333.34 330.81 344064 121 334.25 338.75 336.31 348160 120 337.27 342.06 339.63 352256 119 341.34 346.45 344.05 356352 117 344.58 350.61 347.78 360448 116 349.56 354.99 352.34 364544 115 354.05 359.15 356.53 368640 113 357.47 363.39 360.67 372736 112 361.00 367.73 364.66 376832 111 364.08 370.87 367.71 380928 110 368.73 374.89 371.90 385024 108 373.89 379.59 376.69 389120 107 376.32 382.66 379.72 393216 106 380.15 387.59 384.18 397312 105 383.47 390.97 387.50 401408 104 390.19 397.00 393.59 405504 103 395.56 401.77 398.52 409600 102 399.14 405.79 402.41 413696 101 401.74 408.92 405.64 417792 100 407.10 415.68 411.84 421888 99 407.31 415.85 411.88 425984 98 413.06 420.89 417.17 430080 97 417.01 423.81 420.15 434176 96 421.19 428.52 424.75 438272 95 424.25 432.13 428.47 442368 94 428.50 437.84 433.50 446464 93 432.28 441.65 437.33 450560 93 437.66 447.09 442.73 454656 92 441.52 450.09 445.87 458752 91 447.50 455.49 451.30 462848 90 450.01 458.33 454.05 466944 89 453.57 462.75 458.52 471040 89 457.63 466.58 462.42 475136 88 461.15 472.02 467.11 479232 87 465.16 476.28 471.07 483328 86 471.41 481.30 476.40 487424 86 475.45 485.32 480.49 491520 85 481.07 489.64 484.86 495616 84 484.41 493.50 488.82 499712 83 488.38 498.40 493.74 503808 83 491.60 501.71 496.95 507904 82 494.79 506.78 501.16 512000 81 500.06 512.21 506.56 516096 81 501.23 513.78 507.93 520192 80 502.55 513.74 508.06 524288 80 463.17 468.81 467.02 528384 79 470.66 475.20 473.48 532480 78 474.72 480.30 478.63 536576 78 479.26 485.09 483.36 540672 77 479.94 486.54 484.14 544768 76 479.60 484.71 483.07 548864 76 479.65 485.59 483.72 552960 75 485.64 490.80 488.86 557056 75 486.49 492.30 490.15 561152 74 490.05 496.27 494.34 565248 74 491.85 497.98 496.06 569344 73 496.85 503.01 500.77 573440 73 501.01 506.85 504.68 577536 72 501.41 506.76 504.71 581632 72 506.16 511.46 509.45 585728 71 510.40 515.73 513.76 589824 71 512.82 518.40 516.36 593920 70 517.73 523.44 521.38 598016 70 520.41 525.96 523.90 602112 69 525.13 531.41 529.24 606208 69 523.70 529.62 527.60 610304 68 533.47 540.88 538.52 614400 68 535.91 543.38 541.03 618496 67 537.38 543.53 541.19 622592 67 541.82 547.90 545.57 626688 66 547.39 555.22 552.92 630784 66 555.02 562.87 560.57 634880 66 556.41 564.32 561.99 638976 65 557.18 565.99 562.70 643072 65 559.86 568.73 565.48 647168 64 560.50 568.69 566.16 651264 64 562.21 570.33 567.79 655360 64 563.95 571.30 568.96 659456 63 563.80 570.95 568.32 663552 63 571.73 578.83 576.22 667648 62 574.14 582.86 580.18 671744 62 579.71 588.52 585.88 675840 62 585.64 594.50 591.84 679936 61 586.50 595.10 591.94 684032 61 588.82 597.03 593.92 688128 60 597.85 605.88 602.84 692224 60 598.27 606.07 603.10 696320 60 599.59 607.19 604.16 700416 59 606.82 614.35 611.45 704512 59 610.15 617.83 614.89 708608 59 610.84 618.62 615.65 712704 58 613.44 621.70 618.64 716800 58 617.73 626.00 622.93 720896 58 621.76 630.06 627.01 724992 57 624.16 633.20 630.03 729088 57 626.09 635.16 631.98 733184 57 628.43 637.63 634.42 737280 56 633.90 644.23 640.93 741376 56 627.40 638.04 634.64 745472 56 627.67 638.23 634.86 749568 55 635.68 644.60 641.16 753664 55 641.00 649.81 646.41 757760 55 641.73 650.55 647.12 761856 55 643.69 652.57 649.12 765952 54 649.47 660.57 657.26 770048 54 648.58 659.76 656.46 774144 54 650.49 661.66 658.34 778240 53 655.35 666.75 662.46 782336 53 657.99 669.38 665.14 786432 53 660.52 672.15 667.82 790528 53 661.59 672.92 668.65 794624 52 652.76 663.28 659.79 798720 52 655.83 666.26 662.80 802816 52 669.80 680.04 676.60 806912 51 667.98 677.50 673.94 811008 51 670.65 680.07 676.57 815104 51 677.53 688.13 684.13 819200 51 685.56 696.55 692.50 823296 50 689.19 702.33 698.38 827392 50 687.34 700.60 696.61 831488 50 698.22 711.46 707.51 835584 50 695.10 708.35 704.38 839680 49 695.81 707.54 703.09 843776 49 703.16 714.44 710.09 847872 49 701.25 712.99 708.52 851968 49 706.13 717.90 713.43 856064 48 697.98 709.61 705.10 860160 48 708.49 720.44 715.98 864256 48 714.36 725.89 721.39 868352 48 715.66 727.66 723.22 872448 48 717.54 729.77 725.21 876544 47 723.73 735.64 731.16 880640 47 723.53 735.54 731.14 884736 47 730.36 742.35 737.78 888832 47 735.12 746.23 742.11 892928 46 738.27 750.96 746.31 897024 46 748.70 761.38 756.74 901120 46 747.83 760.34 755.73 905216 46 736.72 749.68 744.95 909312 46 751.27 763.91 759.29 913408 45 739.59 753.26 748.41 917504 45 745.21 758.79 753.96 921600 45 762.11 775.97 771.06 925696 45 756.27 770.10 765.14 929792 45 755.39 769.33 764.36 933888 44 761.27 777.48 772.32 937984 44 762.19 778.31 773.08 942080 44 765.50 781.69 776.53 946176 44 767.31 783.58 778.35 950272 44 763.03 779.36 774.12 954368 43 775.96 789.93 784.47 958464 43 778.05 792.06 786.54 962560 43 787.32 801.38 795.89 966656 43 782.62 797.17 791.46 970752 43 790.45 804.59 799.08 974848 43 804.82 819.34 813.78 978944 42 808.43 826.21 820.96 983040 42 808.06 825.75 820.57 987136 42 816.04 834.03 828.75 991232 42 815.51 834.18 828.73 995328 42 818.50 836.78 831.38 999424 41 823.05 841.26 834.36 1003520 41 826.07 844.44 837.58 1007616 41 829.73 847.87 841.07 1011712 41 832.11 850.26 843.41 1015808 41 838.33 856.84 849.92 1019904 41 849.32 868.68 861.40 1024000 40 843.65 863.81 857.61 1028096 40 851.30 871.70 865.46 1032192 40 859.03 879.41 873.18 1036288 40 854.81 875.50 869.21 1040384 40 865.69 886.37 880.07 1044480 40 863.17 881.62 875.74 1048576 40 906.13 926.64 920.30 #---------------------------------------------------------------- # Benchmarking Reduce_scatter # #processes = 12 #---------------------------------------------------------------- #bytes #repetitions t_min[usec] t_max[usec] t_avg[usec] 0 1000 0.06 0.06 0.06 4096 1000 7.36 7.36 7.36 8192 1000 12.37 12.37 12.37 12288 1000 16.05 16.06 16.06 16384 1000 25.56 25.57 25.57 20480 1000 28.92 28.93 28.93 24576 1000 31.18 31.19 31.18 28672 1000 33.40 33.40 33.40 32768 1000 44.43 44.45 44.44 36864 1000 42.45 42.46 42.46 40960 1000 45.70 45.71 45.70 45056 930 49.41 49.42 49.41 49152 853 52.37 52.39 52.38 53248 787 54.93 54.94 54.94 57344 731 59.25 59.27 59.26 61440 682 65.64 65.66 65.65 65536 640 67.83 67.85 67.84 69632 602 64.53 64.55 64.54 73728 568 64.50 64.52 64.51 77824 538 67.61 67.63 67.62 81920 512 70.78 70.81 70.79 86016 487 73.50 73.53 73.51 90112 465 75.60 75.63 75.61 94208 445 79.96 80.00 79.98 98304 426 83.00 83.05 83.03 102400 409 83.69 83.72 83.71 106496 393 85.21 85.24 85.22 110592 379 86.45 86.49 86.47 114688 365 88.41 88.46 88.43 118784 353 90.41 90.46 90.43 122880 341 91.27 91.33 91.30 126976 330 94.45 94.49 94.47 131072 320 97.66 97.71 97.68 135168 310 100.00 100.06 100.03 139264 301 101.53 101.58 101.55 143360 292 107.35 107.42 107.38 147456 284 110.82 110.89 110.86 151552 276 108.98 109.05 109.01 155648 269 111.20 111.29 111.24 159744 262 114.57 114.66 114.61 163840 256 114.13 114.20 114.16 167936 249 117.22 117.32 117.27 172032 243 121.85 121.93 121.88 176128 238 117.88 117.97 117.92 180224 232 121.41 121.53 121.47 184320 227 129.10 129.23 129.15 188416 222 125.15 125.27 125.21 192512 217 130.60 130.71 130.65 196608 213 140.29 140.38 140.33 200704 208 133.85 133.97 133.91 204800 204 136.95 137.02 136.99 208896 200 141.53 141.66 141.59 212992 196 138.65 138.77 138.70 217088 193 144.71 144.86 144.77 221184 189 142.65 142.79 142.72 225280 186 144.15 144.30 144.22 229376 182 146.37 146.49 146.42 233472 179 156.21 156.43 156.32 237568 176 151.93 152.03 151.98 241664 173 157.10 157.30 157.19 245760 170 166.28 166.53 166.39 249856 167 160.28 160.46 160.37 253952 165 163.19 163.38 163.28 258048 162 166.69 166.90 166.79 262144 160 165.97 166.12 166.04 266240 157 169.49 169.62 169.54 270336 155 172.91 173.19 173.04 274432 152 174.81 175.06 174.93 278528 150 171.69 171.92 171.79 282624 148 180.44 180.67 180.55 286720 146 175.80 175.95 175.88 290816 144 179.43 179.58 179.50 294912 142 182.91 183.17 183.03 299008 140 184.01 184.23 184.12 303104 138 184.79 185.06 184.91 307200 136 193.06 193.34 193.18 311296 134 189.35 189.59 189.46 315392 132 192.95 193.23 193.08 319488 131 195.51 195.81 195.64 323584 129 194.58 194.80 194.68 327680 128 196.96 197.24 197.09 331776 126 205.18 205.55 205.35 335872 124 202.42 202.71 202.56 339968 123 204.77 205.09 204.91 344064 121 220.67 221.05 220.84 348160 120 209.32 209.56 209.43 352256 119 209.47 209.76 209.60 356352 117 219.67 220.07 219.84 360448 116 212.88 213.17 213.01 364544 115 217.35 217.67 217.48 368640 113 228.97 229.39 229.15 372736 112 219.57 219.98 219.76 376832 111 221.51 221.89 221.67 380928 110 232.95 233.29 233.11 385024 108 229.59 229.93 229.74 389120 107 231.36 231.75 231.55 393216 106 247.85 248.29 248.05 397312 105 229.28 229.65 229.45 401408 104 233.70 234.13 233.90 405504 103 250.05 250.53 250.28 409600 102 239.35 239.77 239.54 413696 101 240.83 241.21 241.00 417792 100 259.70 260.20 259.93 421888 99 245.79 246.27 246.00 425984 98 245.09 245.46 245.26 430080 97 262.68 263.26 262.96 434176 96 252.45 252.86 252.63 438272 95 251.53 251.90 251.69 442368 94 271.05 271.67 271.33 446464 93 255.70 255.99 255.85 450560 93 259.19 259.52 259.37 454656 92 276.17 276.72 276.43 458752 91 261.67 262.09 261.85 462848 90 264.41 264.97 264.64 466944 89 278.37 279.09 278.72 471040 89 269.41 269.97 269.66 475136 88 269.39 269.88 269.60 479232 87 289.02 289.43 289.23 483328 86 274.86 275.29 275.05 487424 86 276.72 277.25 276.98 491520 85 292.30 292.80 292.51 495616 84 277.64 278.31 277.98 499712 83 276.19 276.86 276.51 503808 83 288.46 289.20 288.84 507904 82 283.85 284.29 284.08 512000 81 285.46 286.10 285.77 516096 81 297.54 298.34 297.92 520192 80 291.21 291.72 291.43 524288 80 287.68 288.35 287.97 528384 79 299.09 299.87 299.45 532480 78 292.22 292.78 292.46 536576 78 299.78 300.32 300.01 540672 77 304.30 304.94 304.58 544768 76 300.15 300.82 300.46 548864 76 303.66 304.40 303.99 552960 75 293.00 293.61 293.27 557056 75 307.95 308.74 308.31 561152 74 306.63 307.20 306.87 565248 74 299.59 300.19 299.86 569344 73 312.60 313.27 312.90 573440 73 311.64 312.51 312.05 577536 72 296.21 296.89 296.52 581632 72 316.94 317.33 317.14 585728 71 317.01 317.47 317.24 589824 71 280.81 281.30 281.04 593920 70 325.47 326.14 325.74 598016 70 325.79 326.44 326.07 602112 69 285.12 285.58 285.34 606208 69 327.36 328.31 327.80 610304 68 329.09 329.72 329.35 614400 68 293.73 294.17 293.95 618496 67 330.59 331.15 330.85 622592 67 335.25 336.11 335.68 626688 66 296.75 297.23 296.98 630784 66 332.92 333.58 333.21 634880 66 333.40 334.09 333.74 638976 65 305.26 305.71 305.47 643072 65 335.70 336.35 335.98 647168 64 338.21 338.96 338.54 651264 64 310.63 311.05 310.82 655360 64 342.80 343.48 343.08 659456 63 345.51 346.24 345.83 663552 63 313.83 314.33 314.08 667648 62 349.79 350.43 350.09 671744 62 353.26 354.01 353.62 675840 62 314.81 315.31 315.10 679936 61 353.14 354.33 353.71 684032 61 344.95 346.10 345.49 688128 60 317.48 318.34 317.87 692224 60 350.77 352.05 351.37 696320 60 352.51 353.78 353.12 700416 59 322.35 323.39 322.85 704512 59 361.03 362.04 361.46 708608 59 357.17 358.38 357.76 712704 58 324.96 325.86 325.36 716800 58 362.26 363.56 362.89 720896 58 364.32 365.58 364.93 724992 57 332.43 333.44 332.92 729088 57 368.19 369.38 368.74 733184 57 369.69 370.90 370.27 737280 56 341.27 342.22 341.69 741376 56 374.09 375.32 374.67 745472 56 373.43 374.70 374.02 749568 55 342.88 343.96 343.39 753664 55 381.23 382.48 381.78 757760 55 382.81 384.14 383.43 761856 55 339.52 340.28 339.82 765952 54 384.49 385.95 385.15 770048 54 388.72 390.09 389.36 774144 54 353.91 354.96 354.41 778240 53 395.69 396.97 396.25 782336 53 398.39 399.79 399.00 786432 53 367.51 368.68 368.06 790528 53 424.96 426.54 425.71 794624 52 425.84 427.16 426.38 798720 52 439.70 441.41 440.49 802816 52 430.29 431.86 431.02 806912 51 432.50 434.09 433.22 811008 51 442.80 444.53 443.61 815104 51 439.22 440.94 440.03 819200 51 439.15 440.97 440.01 823296 50 448.62 450.52 449.52 827392 50 443.17 444.86 443.95 831488 50 448.54 450.15 449.25 835584 50 458.97 460.83 459.83 839680 49 451.66 453.43 452.48 843776 49 452.24 454.23 453.18 847872 49 466.75 468.60 467.61 851968 49 455.93 457.66 456.71 856064 48 459.75 461.62 460.65 860160 48 472.16 474.18 473.13 864256 48 464.88 466.75 465.75 868352 48 470.43 472.56 471.41 872448 48 480.95 483.08 481.88 876544 47 469.15 471.05 470.06 880640 47 472.37 474.06 473.12 884736 47 483.51 485.63 484.53 888832 47 483.79 485.83 484.73 892928 46 477.94 479.99 478.85 897024 46 494.09 496.21 495.05 901120 46 482.94 484.91 483.88 905216 46 484.76 486.73 485.65 909312 46 498.02 500.01 498.95 913408 45 487.41 489.47 488.37 917504 45 492.42 494.67 493.48 921600 45 508.78 510.49 509.54 925696 45 504.41 506.59 505.46 929792 45 523.79 526.05 524.88 933888 44 533.82 536.36 535.04 937984 44 527.38 529.69 528.50 942080 44 528.31 530.71 529.44 946176 44 546.18 548.82 547.38 950272 44 531.50 533.92 532.65 954368 43 536.82 539.28 537.99 958464 43 549.61 552.13 550.84 962560 43 537.96 540.42 539.14 966656 43 542.93 545.62 544.23 970752 43 555.07 557.81 556.36 974848 43 554.89 557.52 556.14 978944 42 550.76 553.26 551.96 983040 42 560.04 562.84 561.39 987136 42 553.59 556.25 554.90 991232 42 554.74 557.38 555.98 995328 42 567.33 570.09 568.62 999424 41 559.50 562.28 560.85 1003520 41 565.12 567.70 566.26 1007616 41 574.37 577.10 575.66 1011712 41 568.02 570.81 569.35 1015808 41 568.63 571.38 569.96 1019904 41 580.76 583.71 582.20 1024000 40 574.21 577.07 575.63 1028096 40 579.71 582.41 580.95 1032192 40 586.83 589.63 588.25 1036288 40 582.36 585.00 583.60 1040384 40 585.10 588.14 586.52 1044480 40 595.30 598.54 596.76 1048576 40 582.34 585.38 583.69 #---------------------------------------------------------------- # Benchmarking Allgather # #processes = 12 #---------------------------------------------------------------- #bytes #repetitions t_min[usec] t_max[usec] t_avg[usec] 0 1000 3.00 3.00 3.00 4096 1000 41.87 41.88 41.87 8192 1000 30.39 30.39 30.39 12288 1000 34.86 34.86 34.86 16384 1000 39.93 39.93 39.93 20480 1000 44.38 44.38 44.38 24576 1000 49.78 49.78 49.78 28672 1000 53.48 53.48 53.48 32768 1000 57.49 57.49 57.49 36864 1000 59.91 59.91 59.91 40960 1000 63.83 63.83 63.83 45056 930 68.50 68.50 68.50 49152 853 69.87 69.87 69.87 53248 787 80.30 80.30 80.30 57344 731 84.95 84.95 84.95 61440 682 86.32 86.32 86.32 65536 640 88.68 88.68 88.68 69632 602 338.23 338.35 338.29 73728 568 369.42 369.61 369.52 77824 538 421.70 421.93 421.83 81920 512 444.40 444.65 444.54 86016 487 420.76 420.95 420.86 90112 465 437.22 437.49 437.37 94208 445 481.65 481.96 481.82 98304 426 448.62 448.89 448.77 102400 409 476.45 476.79 476.64 106496 393 487.39 487.68 487.56 110592 379 555.88 556.29 556.11 114688 365 552.20 552.61 552.42 118784 353 540.47 540.73 540.59 122880 341 558.00 558.34 558.19 126976 330 576.32 576.69 576.52 131072 320 643.50 644.08 643.81 135168 310 655.43 656.04 655.76 139264 301 598.57 599.05 598.84 143360 292 653.19 653.87 653.56 147456 284 637.32 637.86 637.62 151552 276 684.22 685.02 684.68 155648 269 747.83 748.60 748.25 159744 262 778.49 779.31 778.94 163840 256 795.41 796.26 795.88 167936 249 819.40 820.29 819.89 172032 243 845.43 846.07 845.80 176128 238 846.46 847.46 847.01 180224 232 857.58 858.62 858.14 184320 227 880.91 882.06 881.55 188416 222 891.16 892.25 891.74 192512 217 919.41 920.55 920.02 196608 213 894.72 895.96 895.40 200704 208 914.56 915.86 915.27 204800 204 822.65 823.15 822.92 208896 200 943.46 944.80 944.19 212992 196 1004.86 1006.29 1005.64 217088 193 1034.16 1035.68 1034.99 221184 189 891.73 892.33 892.06 225280 186 1040.70 1042.31 1041.59 229376 182 943.33 943.75 943.60 233472 179 956.99 958.19 957.65 237568 176 972.43 973.05 972.80 241664 173 1114.27 1116.11 1115.27 245760 170 1148.46 1150.42 1149.53 249856 167 998.40 999.13 998.79 253952 165 1016.80 1017.47 1017.16 258048 162 1186.99 1189.01 1188.11 262144 160 1199.21 1201.32 1200.35 266240 157 1276.82 1278.97 1277.98 270336 155 1303.43 1305.72 1304.67 274432 152 1317.90 1320.17 1319.13 278528 150 1325.82 1328.29 1327.18 282624 148 1359.67 1362.11 1360.97 286720 146 1373.33 1375.91 1374.74 290816 144 1408.22 1410.88 1409.66 294912 142 1434.66 1437.41 1436.15 299008 140 1397.12 1398.77 1397.86 303104 138 1457.08 1459.90 1458.58 307200 136 1485.77 1488.76 1487.38 311296 134 1380.62 1382.65 1381.74 315392 132 1503.94 1506.96 1505.55 319488 131 1537.17 1540.25 1538.82 323584 129 1562.54 1565.86 1564.31 327680 128 1557.15 1560.39 1558.89 331776 126 1595.18 1598.55 1596.98 335872 124 1613.66 1617.18 1615.56 339968 123 1626.20 1629.75 1628.08 344064 121 1646.49 1650.06 1648.39 348160 120 1645.88 1649.58 1647.85 352256 119 1674.68 1678.39 1676.64 356352 117 1702.16 1706.06 1704.22 360448 116 1719.95 1723.87 1722.04 364544 115 1733.55 1737.61 1735.74 368640 113 1748.68 1752.97 1750.97 372736 112 1766.69 1770.93 1768.97 376832 111 1795.24 1799.56 1797.52 380928 110 1778.09 1782.46 1780.41 385024 108 1839.67 1844.17 1842.03 389120 107 1751.08 1754.38 1752.92 393216 106 1870.90 1875.51 1873.36 397312 105 1818.12 1821.15 1819.72 401408 104 1914.53 1919.37 1917.09 405504 103 1930.30 1935.29 1932.95 409600 102 1955.29 1960.39 1957.99 413696 101 1964.06 1969.19 1966.79 417792 100 1987.84 1993.08 1990.62 421888 99 1962.92 1968.41 1965.84 425984 98 1973.68 1977.52 1975.80 430080 97 2028.19 2034.01 2031.31 434176 96 1732.15 1735.37 1733.69 438272 95 1778.04 1780.28 1779.21 442368 94 1815.22 1817.80 1816.54 446464 93 2083.54 2089.98 2087.02 450560 93 1837.03 1839.53 1838.27 454656 92 1826.84 1829.41 1828.32 458752 91 1857.75 1860.52 1859.27 462848 90 1865.58 1867.66 1866.90 466944 89 1946.39 1950.39 1948.20 471040 89 2141.65 2148.79 2145.56 475136 88 1904.65 1906.50 1905.79 479232 87 2265.90 2273.49 2270.06 483328 86 2174.83 2182.27 2178.81 487424 86 1956.42 1958.91 1957.94 491520 85 2358.24 2365.59 2362.25 495616 84 1980.79 1984.11 1982.54 499712 83 2343.55 2351.71 2347.91 503808 83 2022.97 2026.87 2024.63 507904 82 2050.16 2054.83 2052.30 512000 81 2055.49 2058.12 2057.07 516096 81 2447.10 2455.31 2451.43 520192 80 2440.57 2448.98 2445.09 524288 80 2483.08 2491.49 2487.64 528384 79 2533.75 2542.12 2538.24 532480 78 2589.01 2597.83 2593.73 536576 78 2583.90 2592.76 2588.67 540672 77 2608.26 2617.48 2613.22 544768 76 2591.13 2600.16 2595.90 548864 76 2571.77 2581.12 2576.86 552960 75 2659.26 2668.79 2664.32 557056 75 2679.15 2689.03 2684.64 561152 74 2717.26 2727.21 2722.54 565248 74 2692.85 2702.69 2698.22 569344 73 2369.30 2379.14 2374.51 573440 73 2777.05 2787.16 2782.38 577536 72 2742.57 2752.76 2747.90 581632 72 2800.08 2810.69 2805.67 585728 71 2796.13 2806.93 2801.81 589824 71 2838.05 2848.72 2843.75 593920 70 2920.62 2931.77 2926.43 598016 70 2940.64 2951.70 2946.42 602112 69 2971.10 2982.07 2976.93 606208 69 2940.05 2951.43 2945.96 610304 68 2925.65 2937.42 2931.83 614400 68 2569.85 2574.86 2572.37 618496 67 2649.59 2658.67 2654.44 622592 67 3058.74 3070.81 3065.02 626688 66 3100.70 3107.95 3103.76 630784 66 3115.79 3128.11 3122.21 634880 66 2573.49 2579.15 2576.24 638976 65 2883.73 2890.74 2887.16 643072 65 2616.54 2623.41 2619.93 647168 64 2654.50 2660.24 2657.72 651264 64 2684.02 2689.33 2686.86 655360 64 2792.63 2800.07 2796.50 659456 63 2937.44 2943.66 2940.58 663552 63 2939.10 2943.91 2941.87 667648 62 2943.60 2952.04 2947.09 671744 62 2883.50 2898.32 2891.34 675840 62 2858.10 2868.18 2863.47 679936 61 3110.98 3125.72 3118.70 684032 61 3315.61 3330.30 3323.31 688128 60 3198.78 3213.68 3206.73 692224 60 3118.84 3127.42 3123.64 696320 60 3134.10 3140.96 3138.15 700416 59 3079.31 3087.06 3082.70 704512 59 3122.54 3132.00 3126.90 708608 59 3181.03 3193.70 3186.76 712704 58 3274.14 3286.25 3280.53 716800 58 3298.14 3309.65 3304.04 720896 58 3065.94 3076.83 3071.43 724992 57 3255.46 3267.66 3261.98 729088 57 3160.35 3172.68 3166.78 733184 57 3398.02 3410.70 3404.66 737280 56 3423.86 3437.46 3430.16 741376 56 3632.17 3649.65 3641.29 745472 56 3300.22 3310.64 3305.14 749568 55 3463.12 3476.39 3469.72 753664 55 3469.68 3479.88 3474.36 757760 55 3529.69 3542.20 3536.18 761856 55 3226.98 3242.12 3233.77 765952 54 3537.39 3551.09 3544.42 770048 54 3841.45 3860.66 3851.61 774144 54 3593.79 3608.41 3600.02 778240 53 3529.84 3550.38 3540.81 782336 53 3656.80 3676.63 3667.20 786432 53 3677.66 3692.27 3685.15 790528 53 3685.77 3706.05 3696.36 794624 52 3593.33 3606.12 3599.34 798720 52 3890.45 3906.13 3897.68 802816 52 4018.70 4039.01 4029.27 806912 51 4003.18 4018.07 4011.05 811008 51 4157.24 4178.37 4168.23 815104 51 4140.60 4161.69 4151.50 819200 51 3956.78 3972.10 3964.48 823296 50 4064.65 4086.68 4076.00 827392 50 4235.22 4257.46 4246.55 831488 50 4192.96 4214.84 4204.13 835584 50 4339.49 4361.52 4350.77 839680 49 4124.10 4140.00 4132.52 843776 49 4219.51 4242.55 4231.45 847872 49 4362.02 4384.93 4373.78 851968 49 4217.79 4236.11 4226.25 856064 48 3991.94 4010.39 4000.01 860160 48 4051.40 4074.76 4063.40 864256 48 4068.78 4091.92 4080.96 868352 48 4104.66 4122.24 4113.48 872448 48 4131.18 4148.88 4140.22 876544 47 4145.54 4163.72 4154.65 880640 47 4178.02 4197.66 4187.04 884736 47 4177.53 4189.70 4184.23 888832 47 4229.06 4249.24 4237.98 892928 46 4245.59 4264.73 4255.56 897024 46 4258.09 4277.72 4268.34 901120 46 4294.84 4314.13 4304.65 905216 46 4343.97 4369.70 4357.37 909312 46 4339.70 4359.77 4350.21 913408 45 4375.49 4396.32 4386.37 917504 45 4387.69 4408.88 4398.80 921600 45 4425.10 4445.85 4435.90 925696 45 4423.45 4444.95 4433.51 929792 45 4478.22 4499.84 4487.94 933888 44 4498.92 4520.96 4508.57 937984 44 4514.52 4536.24 4525.79 942080 44 4940.62 4968.93 4955.33 946176 44 4566.15 4594.73 4580.99 950272 44 4550.78 4571.90 4561.87 954368 43 4575.86 4599.10 4585.95 958464 43 4597.71 4621.07 4607.79 962560 43 4654.70 4677.20 4666.64 966656 43 4983.44 5005.94 4995.12 970752 43 5081.59 5111.57 5097.14 974848 43 4741.26 4771.55 4756.82 978944 42 5165.62 5196.46 5181.47 983040 42 5165.72 5196.55 5181.65 987136 42 5180.36 5211.19 5196.12 991232 42 5218.28 5249.98 5234.61 995328 42 5266.89 5298.44 5283.04 999424 41 5301.83 5334.67 5318.62 1003520 41 5276.88 5310.06 5294.12 1007616 41 5348.64 5381.60 5365.47 1011712 41 5210.79 5243.88 5227.70 1015808 41 5321.25 5353.87 5337.96 1019904 41 5345.49 5378.79 5362.42 1024000 40 5411.68 5445.98 5429.20 1028096 40 5463.58 5498.25 5481.24 1032192 40 4978.64 5004.82 4992.48 1036288 40 5002.70 5029.73 5014.58 1040384 40 5039.10 5067.06 5051.50 1044480 40 5059.34 5085.84 5073.11 1048576 40 5084.90 5112.24 5097.05 #---------------------------------------------------------------- # Benchmarking Allgatherv # #processes = 12 #---------------------------------------------------------------- #bytes #repetitions t_min[usec] t_max[usec] t_avg[usec] 0 1000 0.10 0.11 0.10 4096 1000 21.70 21.70 21.70 8192 1000 60.30 60.31 60.30 12288 1000 78.22 78.24 78.23 16384 1000 98.51 98.53 98.52 20480 1000 131.67 131.71 131.69 24576 1000 130.66 130.70 130.68 28672 1000 152.51 152.54 152.53 32768 1000 191.19 191.25 191.22 36864 1000 205.93 205.96 205.95 40960 1000 239.95 240.02 239.99 45056 930 229.39 229.43 229.41 49152 853 272.48 272.57 272.53 53248 787 296.39 296.50 296.45 57344 731 319.59 319.71 319.66 61440 682 339.30 339.44 339.38 65536 640 345.26 345.42 345.35 69632 602 321.01 321.19 321.11 73728 568 384.25 384.45 384.36 77824 538 340.36 340.51 340.45 81920 512 398.24 398.41 398.34 86016 487 431.94 432.12 432.04 90112 465 456.85 457.12 457.00 94208 445 492.29 492.59 492.45 98304 426 474.31 474.64 474.49 102400 409 458.76 459.11 458.95 106496 393 551.59 551.97 551.80 110592 379 569.07 569.49 569.30 114688 365 592.08 592.51 592.32 118784 353 609.34 609.82 609.59 122880 341 630.40 630.91 630.68 126976 330 651.37 651.90 651.66 131072 320 670.76 671.32 671.07 135168 310 688.59 689.20 688.92 139264 301 706.02 706.64 706.36 143360 292 726.11 726.77 726.47 147456 284 746.62 747.35 747.02 151552 276 765.29 766.03 765.69 155648 269 785.40 786.19 785.83 159744 262 804.83 805.65 805.28 163840 256 820.38 821.26 820.85 167936 249 844.24 844.93 844.57 172032 243 860.33 861.28 860.85 176128 238 880.56 881.56 881.11 180224 232 900.35 901.39 900.92 184320 227 913.91 914.99 914.50 188416 222 939.09 940.24 939.72 192512 217 958.95 960.15 959.61 196608 213 977.25 978.51 977.94 200704 208 997.58 998.87 998.29 204800 204 1014.96 1016.29 1015.69 208896 200 1035.06 1036.49 1035.84 212992 196 1054.98 1056.42 1055.77 217088 193 1074.37 1075.88 1075.20 221184 189 1093.71 1095.26 1094.56 225280 186 1110.76 1112.39 1111.65 229376 182 1132.13 1133.82 1133.06 233472 179 1152.25 1153.99 1153.20 237568 176 1170.70 1172.53 1171.71 241664 173 1189.89 1191.75 1190.91 245760 170 1206.37 1208.26 1207.41 249856 167 1228.24 1230.25 1229.33 253952 165 1247.82 1249.86 1248.94 258048 162 1266.59 1268.70 1267.76 262144 160 1284.97 1287.15 1286.16 266240 157 1304.17 1306.41 1305.40 270336 155 1324.18 1326.52 1325.47 274432 152 1342.01 1344.39 1343.32 278528 150 1361.67 1364.14 1363.04 282624 148 1380.76 1383.28 1382.14 286720 146 1401.07 1403.67 1402.51 290816 144 1418.84 1421.49 1420.30 294912 142 1432.63 1435.36 1434.12 299008 140 1452.78 1455.63 1454.36 303104 138 1475.21 1478.10 1476.80 307200 136 1487.45 1490.43 1489.09 311296 134 1512.62 1515.64 1514.28 315392 132 1532.17 1535.35 1533.92 319488 131 1562.51 1565.77 1564.30 323584 129 1582.60 1585.97 1584.46 327680 128 1588.38 1591.74 1590.22 331776 126 1606.82 1610.29 1608.73 335872 124 1627.77 1631.33 1629.73 339968 123 1646.47 1650.10 1648.46 344064 121 1662.70 1666.38 1664.71 348160 120 1682.93 1686.72 1685.00 352256 119 1708.27 1712.20 1710.39 356352 117 1732.25 1734.42 1733.19 360448 116 1748.18 1752.27 1750.40 364544 115 1765.18 1769.35 1767.45 368640 113 1771.18 1774.50 1773.02 372736 112 1801.23 1805.63 1803.62 376832 111 1829.19 1833.69 1831.63 380928 110 1847.48 1852.12 1850.00 385024 108 1868.93 1873.75 1871.55 389120 107 1881.73 1886.50 1884.31 393216 106 1852.94 1857.89 1855.65 397312 105 1875.31 1880.33 1878.02 401408 104 1702.97 1705.89 1704.41 405504 103 1866.05 1871.27 1868.91 409600 102 1897.52 1902.84 1900.42 413696 101 1758.56 1760.94 1759.85 417792 100 1776.83 1779.79 1778.26 421888 99 2006.10 2012.91 2009.67 425984 98 2195.39 2202.46 2199.11 430080 97 1840.13 1842.71 1841.61 434176 96 1853.49 1858.36 1856.24 438272 95 1874.60 1877.58 1876.13 442368 94 2016.77 2023.02 2020.18 446464 93 1912.41 1916.31 1914.38 450560 93 2003.86 2011.70 2007.96 454656 92 1950.73 1953.89 1952.35 458752 91 1970.57 1973.18 1972.00 462848 90 2303.41 2311.93 2307.93 466944 89 2009.38 2012.13 2010.92 471040 89 2029.97 2032.82 2031.55 475136 88 2045.96 2051.10 2048.78 479232 87 2069.94 2072.79 2071.56 483328 86 2084.16 2088.47 2086.28 487424 86 2172.25 2179.93 2176.40 491520 85 2356.25 2364.00 2360.42 495616 84 2494.10 2503.58 2499.04 499712 83 2163.14 2169.29 2166.53 503808 83 2183.42 2188.98 2186.27 507904 82 2200.64 2206.79 2204.00 512000 81 2400.40 2410.33 2405.60 516096 81 2295.03 2305.23 2300.32 520192 80 2491.98 2502.59 2497.55 524288 80 2407.57 2417.95 2413.01 528384 79 2738.35 2748.84 2743.80 532480 78 2314.60 2321.37 2318.23 536576 78 2338.34 2343.20 2340.74 540672 77 2354.83 2362.14 2358.79 544768 76 2373.55 2381.76 2378.06 548864 76 2494.58 2505.99 2500.44 552960 75 2422.61 2427.04 2425.07 557056 75 2444.16 2449.61 2446.87 561152 74 2896.93 2909.12 2903.14 565248 74 2847.30 2859.77 2853.71 569344 73 2443.73 2452.93 2448.63 573440 73 2471.29 2480.63 2476.27 577536 72 2497.42 2507.00 2502.52 581632 72 2761.13 2774.59 2768.00 585728 71 2542.04 2551.85 2547.20 589824 71 2546.53 2553.08 2549.89 593920 70 2554.87 2561.67 2558.22 598016 70 3171.11 3185.30 3178.35 602112 69 3105.26 3119.70 3112.66 606208 69 3222.17 3236.78 3229.62 610304 68 2674.77 2689.52 2682.27 614400 68 3224.72 3239.72 3232.32 618496 67 3189.90 3204.99 3197.52 622592 67 3294.77 3310.00 3302.44 626688 66 3302.43 3318.34 3310.45 630784 66 3321.16 3336.90 3329.04 634880 66 3333.30 3349.07 3341.22 638976 65 3100.04 3116.17 3108.16 643072 65 3285.56 3301.64 3293.60 647168 64 3441.46 3458.03 3449.79 651264 64 3044.51 3061.19 3052.89 655360 64 3097.99 3114.70 3106.40 659456 63 2920.72 2933.16 2927.07 663552 63 3406.52 3423.65 3415.15 667648 62 3350.48 3367.93 3359.14 671744 62 3337.21 3354.84 3346.00 675840 62 3230.35 3248.04 3239.21 679936 61 2979.52 2992.61 2986.09 684032 61 3041.51 3056.09 3047.93 688128 60 3071.03 3084.32 3077.81 692224 60 3594.74 3613.49 3603.99 696320 60 3141.71 3150.17 3145.37 700416 59 3468.76 3487.94 3478.22 704512 59 3284.94 3299.52 3292.29 708608 59 3278.15 3292.88 3285.60 712704 58 3322.14 3337.25 3329.79 716800 58 3319.81 3334.98 3327.48 720896 58 3370.52 3385.75 3378.27 724992 57 3343.13 3358.78 3351.09 729088 57 3400.76 3416.64 3408.86 733184 57 3446.51 3462.41 3454.52 737280 56 3435.54 3451.88 3443.77 741376 56 3629.28 3650.45 3639.73 745472 56 3508.28 3524.71 3516.57 749568 55 4003.12 4025.79 4014.32 753664 55 3554.73 3571.65 3563.23 757760 55 3578.21 3595.26 3586.78 761856 55 3611.20 3628.25 3619.76 765952 54 3634.26 3651.81 3643.05 770048 54 3655.01 3672.44 3663.74 774144 54 3673.24 3690.87 3682.05 778240 53 3697.50 3715.59 3706.58 782336 53 3721.13 3739.31 3730.22 786432 53 3714.39 3732.63 3723.48 790528 53 3740.13 3758.08 3749.00 794624 52 3768.42 3787.16 3777.73 798720 52 3808.57 3827.53 3817.98 802816 52 3823.38 3842.20 3832.70 806912 51 3822.28 3841.60 3831.83 811008 51 3880.58 3900.03 3890.26 815104 51 3900.50 3919.46 3909.79 819200 51 3912.90 3932.68 3922.70 823296 50 3961.18 3981.16 3971.01 827392 50 3966.97 3987.07 3976.80 831488 50 3965.51 3985.70 3975.45 835584 50 4015.98 4036.18 4025.82 839680 49 3990.04 4010.89 4000.17 843776 49 4059.69 4080.88 4070.04 847872 49 4086.30 4107.04 4096.46 851968 49 4615.69 4643.36 4629.23 856064 48 4090.48 4112.01 4100.89 860160 48 4123.94 4145.39 4134.40 864256 48 4147.09 4168.32 4157.33 868352 48 4173.85 4195.26 4184.22 872448 48 4193.68 4215.72 4204.43 876544 47 4221.92 4244.17 4232.68 880640 47 4486.66 4516.34 4501.14 884736 47 4281.38 4303.68 4292.21 888832 47 4290.45 4312.82 4301.34 892928 46 4879.71 4910.45 4894.67 897024 46 4339.95 4363.07 4351.16 901120 46 4917.30 4948.20 4932.36 905216 46 4945.76 4976.67 4960.87 909312 46 4966.87 4997.90 4981.99 913408 45 4975.89 5007.96 4991.52 917504 45 4693.16 4725.07 4708.77 921600 45 4486.67 4511.53 4498.90 925696 45 4973.04 4997.52 4985.04 929792 45 4546.43 4571.18 4558.38 933888 44 4551.62 4577.07 4564.20 937984 44 4584.39 4610.07 4597.08 942080 44 4609.31 4635.13 4622.06 946176 44 4649.75 4675.47 4662.45 950272 44 4696.52 4722.58 4709.34 954368 43 5253.31 5288.28 5270.35 958464 43 5278.83 5313.57 5295.76 962560 43 4826.45 4853.29 4839.53 966656 43 5327.39 5362.54 5344.43 970752 43 5348.79 5383.86 5365.94 974848 43 5380.46 5416.12 5397.91 978944 42 5401.33 5437.75 5419.08 983040 42 5435.01 5471.70 5452.96 987136 42 4990.87 5026.92 5008.64 991232 42 5476.49 5513.58 5494.67 995328 42 5495.53 5532.57 5513.60 999424 41 5047.46 5077.00 5061.89 1003520 41 5538.63 5576.82 5557.39 1007616 41 5081.63 5111.66 5096.19 1011712 41 5588.57 5626.64 5607.21 1015808 41 5613.60 5652.24 5632.55 1019904 41 5634.89 5673.77 5653.97 1024000 40 5666.24 5706.29 5685.90 1028096 40 5686.75 5726.77 5706.44 1032192 40 5716.50 5756.88 5736.27 1036288 40 5737.92 5778.23 5757.70 1040384 40 5773.66 5814.35 5793.74 1044480 40 5779.03 5819.92 5799.10 1048576 40 5808.04 5848.91 5828.13 #---------------------------------------------------------------- # Benchmarking Gather # #processes = 12 #---------------------------------------------------------------- #bytes #repetitions t_min[usec] t_max[usec] t_avg[usec] 0 1000 0.14 0.14 0.14 4096 1000 2.59 2.61 2.60 8192 1000 11.49 11.50 11.49 12288 1000 14.46 14.47 14.47 16384 1000 17.23 17.24 17.23 20480 1000 19.78 19.79 19.79 24576 1000 22.81 22.82 22.82 28672 1000 26.53 26.55 26.54 32768 1000 29.44 29.46 29.46 36864 1000 32.57 32.59 32.59 40960 1000 35.30 35.32 35.31 45056 930 38.37 38.39 38.38 49152 853 43.28 43.35 43.34 53248 787 46.24 46.27 46.25 57344 731 49.62 49.64 49.63 61440 682 53.79 53.82 53.81 65536 640 55.79 55.83 55.82 69632 602 58.58 58.66 58.64 73728 568 63.92 63.96 63.95 77824 538 68.20 68.25 68.24 81920 512 70.41 70.46 70.44 86016 487 73.53 73.65 73.60 90112 465 75.49 75.67 75.63 94208 445 79.63 80.07 80.02 98304 426 84.98 85.11 85.06 102400 409 91.97 92.43 92.38 106496 393 94.37 94.67 94.61 110592 379 97.02 97.27 97.18 114688 365 100.25 100.39 100.32 118784 353 104.99 105.14 105.06 122880 341 106.93 107.04 106.98 126976 330 112.73 113.09 112.96 131072 320 116.49 116.63 116.58 135168 310 121.14 121.30 121.23 139264 301 127.85 128.31 128.24 143360 292 132.00 132.18 132.12 147456 284 139.21 139.37 139.30 151552 276 142.19 143.22 143.01 155648 269 146.70 147.21 147.03 159744 262 150.40 150.57 150.47 163840 256 158.91 159.14 159.07 167936 249 163.26 163.64 163.50 172032 243 165.79 166.70 166.57 176128 238 170.95 171.23 171.11 180224 232 176.71 176.95 176.86 184320 227 184.46 184.93 184.80 188416 222 186.11 187.44 187.16 192512 217 188.89 189.21 189.05 196608 213 193.96 195.02 194.87 200704 208 201.83 202.16 202.06 204800 204 211.54 213.47 213.14 208896 200 221.31 221.81 221.55 212992 196 226.17 226.51 226.40 217088 193 228.31 229.06 228.85 221184 189 232.25 232.57 232.39 225280 186 239.72 241.21 240.84 229376 182 244.93 246.60 246.25 233472 179 247.26 247.79 247.54 237568 176 256.00 256.43 256.21 241664 173 261.10 262.42 262.17 245760 170 261.75 264.00 263.55 249856 167 263.66 264.56 264.22 253952 165 271.76 272.20 272.01 258048 162 272.82 274.39 273.96 262144 160 279.44 279.95 279.78 266240 157 292.38 293.59 293.22 270336 155 289.08 290.22 289.78 274432 152 289.82 290.53 290.09 278528 150 302.26 304.06 303.60 282624 148 303.73 304.14 303.98 286720 146 295.05 298.02 297.19 290816 144 299.68 302.71 302.13 294912 142 294.84 296.66 296.18 299008 140 290.01 290.93 290.48 303104 138 278.41 280.30 279.80 307200 136 282.95 284.66 284.01 311296 134 268.57 271.59 270.80 315392 132 276.59 279.32 278.82 319488 131 283.33 285.38 284.74 323584 129 285.20 286.87 286.54 327680 128 284.22 285.56 284.97 331776 126 289.14 290.98 290.63 335872 124 287.61 290.40 289.53 339968 123 286.01 286.76 286.45 344064 121 288.56 290.13 289.76 348160 120 291.36 294.46 293.96 352256 119 296.09 298.48 297.81 356352 117 302.71 304.61 303.93 360448 116 308.53 309.82 309.38 364544 115 306.85 308.07 307.65 368640 113 304.30 309.23 308.54 372736 112 310.63 313.83 312.92 376832 111 312.14 313.30 312.89 380928 110 311.38 315.94 314.80 385024 108 321.23 324.40 323.77 389120 107 337.11 339.51 338.92 393216 106 336.20 339.58 338.55 397312 105 332.15 332.80 332.48 401408 104 333.25 334.76 334.07 405504 103 351.64 353.39 352.75 409600 102 343.21 346.73 345.66 413696 101 346.01 351.81 350.87 417792 100 350.16 355.65 354.50 421888 99 356.03 358.50 357.73 425984 98 350.43 354.68 353.63 430080 97 355.93 359.29 358.24 434176 96 349.22 353.09 352.43 438272 95 366.60 369.42 368.81 442368 94 365.53 369.35 368.34 446464 93 373.98 374.71 374.33 450560 93 374.42 375.72 375.14 454656 92 372.73 374.75 373.92 458752 91 380.90 382.54 381.88 462848 90 384.34 388.55 387.46 466944 89 398.94 403.75 402.75 471040 89 378.37 383.99 382.85 475136 88 396.39 403.81 401.87 479232 87 395.42 399.03 398.09 483328 86 387.13 392.64 391.58 487424 86 396.17 401.81 400.64 491520 85 403.41 408.89 407.95 495616 84 409.58 413.07 412.40 499712 83 399.51 403.64 402.44 503808 83 406.96 410.59 409.21 507904 82 420.27 424.77 423.89 512000 81 411.78 416.18 415.23 516096 81 413.52 415.56 414.40 520192 80 405.03 408.37 407.30 524288 80 408.63 411.21 410.30 528384 79 425.85 427.78 427.03 532480 78 412.34 417.22 416.21 536576 78 418.87 423.97 422.92 540672 77 420.97 428.36 426.90 544768 76 432.51 438.48 436.90 548864 76 426.47 432.45 430.88 552960 75 441.12 444.72 443.48 557056 75 444.12 448.64 447.35 561152 74 463.82 471.11 469.04 565248 74 472.01 479.57 477.44 569344 73 452.43 459.49 457.86 573440 73 461.73 469.78 468.62 577536 72 460.92 464.09 463.25 581632 72 482.37 484.77 484.17 585728 71 471.18 477.17 475.29 589824 71 478.68 482.51 481.65 593920 70 480.92 487.00 485.74 598016 70 477.38 483.29 482.20 602112 69 494.47 497.90 496.14 606208 69 484.96 488.58 486.80 610304 68 490.80 496.23 493.91 614400 68 495.94 500.61 498.58 618496 67 498.58 501.28 500.05 622592 67 502.27 506.00 504.24 626688 66 499.97 508.02 506.42 630784 66 509.97 517.98 516.40 634880 66 495.82 503.94 502.32 638976 65 510.27 520.31 518.15 643072 65 522.00 531.26 529.19 647168 64 527.95 535.29 533.39 651264 64 530.25 538.95 536.99 655360 64 542.35 551.18 549.28 659456 63 562.90 569.39 567.42 663552 63 561.44 567.43 565.55 667648 62 571.44 581.98 580.13 671744 62 569.04 579.02 577.09 675840 62 573.99 582.43 580.91 679936 61 570.52 584.18 581.87 684032 61 584.71 590.73 589.50 688128 60 593.75 599.79 597.43 692224 60 601.03 605.74 604.51 696320 60 618.81 624.26 622.32 700416 59 614.23 620.79 618.36 704512 59 606.14 611.47 608.99 708608 59 618.87 627.30 623.84 712704 58 606.57 616.37 613.84 716800 58 607.69 619.00 615.92 720896 58 611.37 620.83 617.87 724992 57 625.32 629.09 627.25 729088 57 625.45 629.95 627.92 733184 57 623.52 628.01 625.94 737280 56 636.97 641.65 639.73 741376 56 644.28 649.41 647.48 745472 56 654.99 660.20 658.10 749568 55 659.45 663.59 661.72 753664 55 648.82 652.75 651.11 757760 55 654.85 659.39 657.43 761856 55 654.52 658.83 657.04 765952 54 660.80 674.30 671.17 770048 54 659.40 673.20 669.94 774144 54 656.11 670.19 666.67 778240 53 661.47 677.01 673.39 782336 53 674.00 689.94 686.20 786432 53 674.72 687.51 684.10 790528 53 669.85 683.61 679.93 794624 52 672.91 686.95 683.48 798720 52 679.69 693.34 689.87 802816 52 676.14 688.93 685.37 806912 51 687.21 694.88 692.36 811008 51 697.29 709.16 706.23 815104 51 704.10 715.40 712.64 819200 51 719.33 730.76 727.86 823296 50 725.15 741.78 737.28 827392 50 726.16 742.80 738.24 831488 50 725.06 741.99 737.40 835584 50 725.69 742.93 738.33 839680 49 741.34 752.77 750.30 843776 49 736.53 749.08 746.18 847872 49 748.79 763.49 760.28 851968 49 756.95 769.94 766.77 856064 48 767.42 775.31 772.33 860160 48 763.66 770.05 767.91 864256 48 780.33 786.86 784.70 868352 48 780.68 787.19 784.90 872448 48 790.96 796.79 794.73 876544 47 773.54 781.49 777.78 880640 47 774.52 782.07 778.23 884736 47 798.60 806.85 803.16 888832 47 807.28 816.41 811.97 892928 46 794.17 809.81 805.94 897024 46 796.19 812.34 807.97 901120 46 803.71 819.56 815.41 905216 46 800.91 816.47 812.25 909312 46 805.53 819.04 814.57 913408 45 822.14 828.36 825.04 917504 45 833.40 839.56 836.41 921600 45 834.12 840.46 837.21 925696 45 821.02 827.86 824.50 929792 45 831.87 840.73 835.96 933888 44 844.28 853.97 851.12 937984 44 845.72 854.41 851.39 942080 44 855.33 864.34 861.12 946176 44 875.62 884.49 881.40 950272 44 850.64 859.46 856.38 954368 43 864.90 874.66 870.40 958464 43 887.14 896.45 892.43 962560 43 888.07 897.26 893.51 966656 43 872.41 880.44 877.21 970752 43 881.94 890.54 886.87 974848 43 899.80 907.71 904.25 978944 42 884.33 906.01 900.51 983040 42 882.67 903.25 898.37 987136 42 885.50 907.11 901.57 991232 42 882.56 903.15 898.40 995328 42 891.98 912.85 907.73 999424 41 868.01 889.82 883.64 1003520 41 906.09 931.33 924.89 1007616 41 897.45 919.07 912.56 1011712 41 893.31 918.79 912.38 1015808 41 905.47 930.32 923.73 1019904 41 918.16 942.62 936.25 1024000 40 910.20 935.90 929.16 1028096 40 909.78 935.50 928.69 1032192 40 914.81 941.34 934.79 1036288 40 930.35 956.65 949.75 1040384 40 912.97 939.38 932.25 1044480 40 934.02 960.45 953.48 1048576 40 931.04 957.42 950.38 #---------------------------------------------------------------- # Benchmarking Gatherv # #processes = 12 #---------------------------------------------------------------- #bytes #repetitions t_min[usec] t_max[usec] t_avg[usec] 0 1000 0.07 0.07 0.07 4096 1000 2.48 2.50 2.49 8192 1000 10.44 10.46 10.45 12288 1000 12.18 12.21 12.20 16384 1000 12.21 12.24 12.23 20480 1000 14.76 14.78 14.77 24576 1000 13.93 13.96 13.95 28672 1000 14.05 14.08 14.07 32768 1000 12.77 12.80 12.78 36864 1000 12.93 12.98 12.96 40960 1000 15.92 15.98 15.96 45056 930 15.85 15.89 15.87 49152 853 16.23 16.33 16.29 53248 787 17.83 17.91 17.88 57344 731 18.98 19.11 19.05 61440 682 18.90 19.06 18.99 65536 640 21.19 21.38 21.32 69632 602 23.18 23.38 23.30 73728 568 23.00 23.24 23.16 77824 538 26.44 26.66 26.56 81920 512 28.86 29.03 28.96 86016 487 31.10 31.22 31.16 90112 465 38.13 38.46 38.32 94208 445 37.22 37.61 37.46 98304 426 36.70 37.06 36.94 102400 409 51.19 51.61 51.45 106496 393 43.92 44.23 44.09 110592 379 40.92 41.25 41.08 114688 365 47.49 47.92 47.74 118784 353 43.04 43.57 43.37 122880 341 38.62 39.22 39.02 126976 330 57.21 57.80 57.58 131072 320 53.06 53.49 53.27 135168 310 38.07 38.69 38.44 139264 301 70.19 70.76 70.50 143360 292 48.38 49.31 48.99 147456 284 80.45 81.01 80.77 151552 276 46.25 47.27 46.85 155648 269 45.69 46.43 46.15 159744 262 55.93 56.56 56.30 163840 256 59.30 60.02 59.66 167936 249 64.69 65.99 65.46 172032 243 51.54 52.76 52.33 176128 238 50.41 51.36 50.84 180224 232 108.99 110.35 109.77 184320 227 54.33 55.22 54.79 188416 222 68.47 69.51 69.14 192512 217 88.63 89.65 89.14 196608 213 86.67 88.21 87.52 200704 208 83.65 84.87 84.43 204800 204 94.20 95.63 95.05 208896 200 110.26 112.13 111.22 212992 196 90.39 91.25 90.91 217088 193 109.53 111.25 110.41 221184 189 72.12 74.12 73.16 225280 186 81.94 84.03 83.33 229376 182 78.47 80.23 79.42 233472 179 106.72 108.66 107.79 237568 176 83.32 85.18 84.24 241664 173 79.75 81.74 81.01 245760 170 88.25 91.16 90.24 249856 167 101.68 104.05 102.86 253952 165 81.28 84.29 82.80 258048 162 88.19 90.11 89.28 262144 160 105.80 108.25 107.27 266240 157 93.10 96.43 95.14 270336 155 98.12 101.00 99.57 274432 152 98.98 102.17 100.78 278528 150 106.10 108.75 107.66 282624 148 106.98 108.97 108.25 286720 146 110.20 113.54 112.17 290816 144 120.46 123.25 121.97 294912 142 128.33 130.55 129.38 299008 140 134.38 135.78 135.11 303104 138 126.34 128.18 127.41 307200 136 148.08 151.36 150.48 311296 134 115.53 117.94 116.87 315392 132 131.99 135.97 134.23 319488 131 144.39 146.44 145.33 323584 129 137.65 139.94 138.90 327680 128 125.92 129.60 128.01 331776 126 129.40 133.32 131.69 335872 124 137.47 142.79 141.09 339968 123 132.62 137.90 135.96 344064 121 151.97 155.03 153.76 348160 120 152.46 156.59 154.60 352256 119 158.40 160.03 159.30 356352 117 176.46 178.17 177.22 360448 116 169.25 171.34 170.43 364544 115 166.29 169.28 168.01 368640 113 167.32 170.61 169.22 372736 112 169.62 172.39 171.20 376832 111 196.57 198.06 197.42 380928 110 180.89 186.77 184.92 385024 108 165.61 170.39 168.24 389120 107 192.50 196.12 194.43 393216 106 193.07 196.64 195.16 397312 105 167.22 168.74 168.35 401408 104 178.89 180.97 179.74 405504 103 192.45 194.84 194.01 409600 102 187.17 190.88 189.69 413696 101 153.47 158.43 156.51 417792 100 174.09 177.03 175.73 421888 99 233.80 239.02 237.03 425984 98 185.11 187.52 186.41 430080 97 188.68 192.78 190.86 434176 96 195.69 199.52 197.72 438272 95 208.19 214.41 211.61 442368 94 208.40 212.15 210.95 446464 93 225.21 228.56 227.04 450560 93 226.09 228.01 227.58 454656 92 286.92 291.78 289.37 458752 91 217.71 223.03 222.15 462848 90 244.46 248.01 246.42 466944 89 266.53 271.53 269.28 471040 89 232.30 235.85 234.51 475136 88 260.34 263.14 262.01 479232 87 257.42 261.08 259.70 483328 86 266.42 271.57 269.16 487424 86 283.14 287.75 285.85 491520 85 234.70 239.34 237.68 495616 84 242.32 247.07 244.52 499712 83 295.17 299.90 298.34 503808 83 270.21 275.43 273.24 507904 82 220.01 225.89 223.07 512000 81 263.74 270.16 267.14 516096 81 318.50 321.87 320.63 520192 80 255.08 260.14 257.52 524288 80 290.48 294.24 292.23 528384 79 284.35 289.20 288.46 532480 78 280.31 284.96 282.77 536576 78 289.28 295.69 293.13 540672 77 331.23 336.27 335.07 544768 76 311.78 318.51 316.39 548864 76 259.82 265.01 263.28 552960 75 333.51 340.91 338.67 557056 75 308.82 316.69 313.89 561152 74 320.16 326.53 323.44 565248 74 362.40 365.98 364.26 569344 73 320.14 326.48 323.87 573440 73 385.17 392.29 389.29 577536 72 329.03 333.94 331.71 581632 72 352.54 361.74 357.80 585728 71 376.72 383.83 381.36 589824 71 362.72 369.39 366.57 593920 70 362.06 373.26 367.48 598016 70 367.91 376.00 372.01 602112 69 404.15 407.33 405.86 606208 69 397.65 407.35 402.49 610304 68 431.35 437.87 434.31 614400 68 436.25 445.04 441.12 618496 67 383.35 388.57 386.34 622592 67 446.07 451.81 450.62 626688 66 442.48 450.56 448.52 630784 66 395.18 403.67 400.05 634880 66 379.05 385.84 384.12 638976 65 463.19 473.84 471.68 643072 65 504.17 513.43 511.46 647168 64 502.25 510.00 507.83 651264 64 383.68 391.22 388.72 655360 64 466.30 477.05 473.22 659456 63 407.07 416.49 413.19 663552 63 520.05 529.12 525.08 667648 62 485.28 494.55 491.12 671744 62 472.10 482.49 478.06 675840 62 476.69 484.39 480.99 679936 61 488.56 498.17 493.39 684032 61 459.12 466.68 464.03 688128 60 473.66 478.54 477.18 692224 60 496.67 504.94 501.79 696320 60 617.59 624.18 621.68 700416 59 547.00 555.28 551.55 704512 59 531.95 544.36 538.31 708608 59 517.40 527.09 523.37 712704 58 523.44 529.75 526.35 716800 58 582.90 590.17 586.35 720896 58 596.22 607.57 602.22 724992 57 407.05 410.43 408.78 729088 57 574.89 588.17 582.64 733184 57 493.61 496.45 495.33 737280 56 513.37 520.68 516.29 741376 56 572.10 579.90 577.50 745472 56 581.70 593.44 590.07 749568 55 547.42 564.03 561.75 753664 55 564.27 576.34 574.49 757760 55 553.51 560.53 558.66 761856 55 512.74 525.79 521.98 765952 54 503.20 516.86 511.73 770048 54 570.52 581.30 577.85 774144 54 602.51 613.99 612.01 778240 53 563.49 575.25 573.07 782336 53 684.19 698.46 696.72 786432 53 509.73 520.60 518.68 790528 53 653.29 665.60 663.19 794624 52 643.11 652.34 647.56 798720 52 534.12 548.41 544.87 802816 52 622.32 633.79 630.40 806912 51 665.48 679.67 675.61 811008 51 706.65 718.42 714.94 815104 51 599.53 609.47 605.89 819200 51 588.44 602.39 598.24 823296 50 614.66 626.35 622.15 827392 50 570.97 582.20 576.36 831488 50 664.83 681.63 676.25 835584 50 603.25 613.23 607.81 839680 49 695.75 709.83 706.14 843776 49 529.12 545.49 539.40 847872 49 628.51 642.96 637.67 851968 49 571.95 585.05 579.48 856064 48 484.26 499.48 491.92 860160 48 668.46 679.68 673.76 864256 48 645.04 653.13 650.00 868352 48 596.33 607.13 602.66 872448 48 495.33 515.08 505.84 876544 47 730.12 744.57 738.69 880640 47 665.64 678.61 673.73 884736 47 562.34 574.76 570.81 888832 47 579.10 593.45 587.32 892928 46 616.94 631.11 627.80 897024 46 793.71 806.90 803.45 901120 46 742.38 758.62 753.05 905216 46 587.65 603.31 594.37 909312 46 715.23 732.60 728.56 913408 45 797.71 810.31 806.74 917504 45 716.92 728.01 725.29 921600 45 700.63 713.10 710.39 925696 45 713.50 725.32 722.73 929792 45 753.21 766.89 763.86 933888 44 758.79 775.07 770.92 937984 44 777.95 797.39 792.84 942080 44 678.15 691.39 686.01 946176 44 639.70 656.86 648.98 950272 44 753.53 767.23 761.68 954368 43 821.01 835.12 831.45 958464 43 790.80 811.71 805.47 962560 43 865.89 877.85 874.99 966656 43 748.53 768.83 762.37 970752 43 837.94 865.74 860.09 974848 43 824.85 839.58 835.09 978944 42 762.36 780.00 775.90 983040 42 814.68 831.30 826.88 987136 42 861.35 882.05 871.88 991232 42 829.70 845.00 841.47 995328 42 885.61 906.76 899.91 999424 41 844.05 863.92 857.05 1003520 41 866.16 884.59 876.94 1007616 41 799.24 817.01 810.71 1011712 41 816.88 834.93 830.07 1015808 41 849.59 868.65 861.86 1019904 41 851.97 870.45 863.76 1024000 40 864.37 885.46 876.83 1028096 40 860.09 878.57 873.07 1032192 40 898.50 919.91 914.18 1036288 40 880.42 903.31 897.41 1040384 40 873.14 893.81 887.44 1044480 40 916.00 933.61 928.99 1048576 40 922.20 944.98 938.91 #---------------------------------------------------------------- # Benchmarking Scatter # #processes = 12 #---------------------------------------------------------------- #bytes #repetitions t_min[usec] t_max[usec] t_avg[usec] 0 1000 0.21 0.22 0.22 4096 1000 5.70 5.71 5.71 8192 1000 11.58 11.59 11.59 12288 1000 14.58 14.59 14.58 16384 1000 17.91 17.92 17.92 20480 1000 20.61 20.63 20.63 24576 1000 23.22 23.24 23.24 28672 1000 25.89 25.91 25.90 32768 1000 28.43 28.45 28.44 36864 1000 30.72 30.74 30.73 40960 1000 33.42 33.44 33.43 45056 930 36.17 36.20 36.19 49152 853 38.21 38.24 38.23 53248 787 40.41 40.43 40.42 57344 731 42.37 42.39 42.38 61440 682 44.30 44.37 44.36 65536 640 45.91 45.93 45.92 69632 602 47.48 47.57 47.55 73728 568 48.83 48.86 48.85 77824 538 50.71 50.79 50.77 81920 512 52.30 52.35 52.33 86016 487 54.09 54.12 54.11 90112 465 55.54 55.60 55.57 94208 445 57.80 57.84 57.82 98304 426 59.36 59.45 59.42 102400 409 61.28 61.35 61.32 106496 393 62.82 62.87 62.85 110592 379 63.57 63.67 63.64 114688 365 65.67 65.79 65.76 118784 353 65.81 65.95 65.91 122880 341 69.58 69.69 69.66 126976 330 70.92 71.10 71.06 131072 320 74.13 74.22 74.19 135168 310 76.67 76.89 76.86 139264 301 79.28 79.47 79.44 143360 292 80.51 80.87 80.79 147456 284 83.82 83.93 83.87 151552 276 87.71 87.99 87.90 155648 269 90.59 90.87 90.77 159744 262 89.25 89.64 89.57 163840 256 90.17 90.47 90.40 167936 249 94.54 94.74 94.65 172032 243 93.18 93.58 93.49 176128 238 97.71 97.92 97.87 180224 232 97.17 97.62 97.54 184320 227 93.59 93.98 93.88 188416 222 97.01 97.64 97.51 192512 217 94.27 94.74 94.65 196608 213 97.28 97.58 97.46 200704 208 100.02 100.51 100.39 204800 204 100.98 101.60 101.47 208896 200 102.39 102.67 102.53 212992 196 104.29 104.78 104.64 217088 193 106.53 107.21 107.07 221184 189 107.80 108.30 108.14 225280 186 109.79 110.46 110.35 229376 182 111.04 111.25 111.16 233472 179 116.36 116.59 116.51 237568 176 117.84 118.38 118.20 241664 173 119.57 119.78 119.69 245760 170 125.87 126.27 126.11 249856 167 126.21 126.52 126.38 253952 165 129.76 130.61 130.44 258048 162 143.59 144.35 144.14 262144 160 149.36 150.08 149.87 266240 157 149.71 151.24 150.91 270336 155 156.14 156.68 156.48 274432 152 155.40 155.98 155.68 278528 150 170.97 171.77 171.55 282624 148 166.82 167.52 167.28 286720 146 165.36 166.37 166.04 290816 144 164.44 165.63 165.47 294912 142 166.80 167.32 167.11 299008 140 167.08 167.74 167.50 303104 138 173.47 174.39 174.15 307200 136 173.82 175.35 174.85 311296 134 170.38 173.12 172.50 315392 132 170.67 172.01 171.76 319488 131 177.15 177.79 177.58 323584 129 178.57 179.48 179.26 327680 128 181.44 181.95 181.76 331776 126 181.73 182.59 182.24 335872 124 184.41 185.58 185.12 339968 123 189.66 190.08 189.89 344064 121 183.38 185.32 184.94 348160 120 184.69 186.36 185.98 352256 119 180.33 181.41 181.18 356352 117 179.96 181.49 181.13 360448 116 181.81 183.08 182.57 364544 115 215.46 216.26 215.95 368640 113 228.86 230.23 229.62 372736 112 226.37 227.34 227.04 376832 111 248.29 249.37 249.07 380928 110 234.24 237.70 236.77 385024 108 230.94 235.28 234.47 389120 107 239.21 240.70 240.06 393216 106 239.34 239.72 239.56 397312 105 234.06 235.02 234.72 401408 104 233.18 236.05 235.42 405504 103 236.83 237.87 237.48 409600 102 236.90 237.73 237.42 413696 101 247.11 248.25 247.95 417792 100 244.34 245.61 245.20 421888 99 300.71 303.31 302.54 425984 98 321.23 324.25 323.11 430080 97 313.21 318.84 317.64 434176 96 315.98 319.33 317.65 438272 95 308.04 309.31 308.74 442368 94 293.61 294.43 294.25 446464 93 303.46 308.11 307.08 450560 93 294.32 296.51 295.93 454656 92 305.38 309.85 308.93 458752 91 298.63 299.82 299.33 462848 90 311.44 313.05 312.25 466944 89 326.75 330.41 329.53 471040 89 329.09 333.08 332.09 475136 88 321.15 327.00 325.43 479232 87 323.02 327.35 326.20 483328 86 323.58 328.12 327.25 487424 86 328.73 333.24 332.03 491520 85 337.13 344.05 342.72 495616 84 343.41 344.83 344.34 499712 83 341.06 344.96 343.90 503808 83 365.16 369.10 367.96 507904 82 371.61 374.23 373.45 512000 81 383.33 384.75 383.88 516096 81 383.54 384.87 384.31 520192 80 381.64 385.24 383.78 524288 80 382.02 385.50 383.77 528384 79 384.02 386.10 385.02 532480 78 407.71 412.07 410.76 536576 78 383.82 388.30 386.75 540672 77 418.11 422.79 421.74 544768 76 421.07 426.41 425.23 548864 76 422.71 428.14 427.04 552960 75 412.33 418.76 417.59 557056 75 416.05 422.00 421.01 561152 74 419.07 424.66 423.38 565248 74 417.26 423.34 421.97 569344 73 405.62 412.84 411.46 573440 73 426.95 431.94 430.93 577536 72 402.33 409.77 408.59 581632 72 410.38 418.59 417.03 585728 71 417.67 420.43 419.56 589824 71 410.95 415.90 414.43 593920 70 427.22 431.00 429.76 598016 70 436.20 440.21 439.21 602112 69 417.21 422.20 420.50 606208 69 439.72 444.53 443.36 610304 68 457.04 463.44 462.28 614400 68 452.67 459.43 457.74 618496 67 458.58 461.52 460.80 622592 67 452.77 455.26 454.38 626688 66 438.02 442.34 440.68 630784 66 468.75 473.60 471.66 634880 66 464.79 468.90 467.35 638976 65 468.01 473.25 471.95 643072 65 473.66 479.31 478.10 647168 64 464.29 472.41 470.91 651264 64 463.74 471.81 469.91 655360 64 475.44 485.29 483.28 659456 63 489.17 495.30 493.72 663552 63 498.50 504.93 503.28 667648 62 481.94 487.62 486.63 671744 62 482.04 489.50 488.42 675840 62 513.17 518.81 518.02 679936 61 494.81 503.83 502.00 684032 61 496.57 501.36 500.20 688128 60 511.48 519.82 516.41 692224 60 511.18 520.84 517.47 696320 60 505.61 515.92 512.73 700416 59 522.88 529.16 527.36 704512 59 500.84 506.94 504.97 708608 59 540.23 550.27 547.26 712704 58 539.92 549.29 547.93 716800 58 525.05 533.06 531.38 720896 58 537.69 544.41 542.92 724992 57 549.42 552.49 551.19 729088 57 553.38 555.85 554.56 733184 57 550.21 554.73 553.25 737280 56 554.68 560.78 558.68 741376 56 537.23 545.34 543.23 745472 56 555.06 562.55 560.36 749568 55 557.54 561.44 560.35 753664 55 543.92 546.69 545.99 757760 55 545.15 550.57 549.01 761856 55 556.63 563.00 560.74 765952 54 552.44 560.35 558.15 770048 54 554.70 563.83 560.87 774144 54 562.17 570.80 568.08 778240 53 563.25 573.91 571.86 782336 53 582.62 593.08 590.83 786432 53 578.01 589.02 586.89 790528 53 588.70 599.72 597.66 794624 52 579.46 590.88 588.47 798720 52 596.53 608.10 605.71 802816 52 592.23 603.84 601.53 806912 51 595.29 600.79 599.17 811008 51 593.16 600.25 598.89 815104 51 603.09 607.25 605.61 819200 51 620.13 631.04 628.65 823296 50 641.23 645.62 644.05 827392 50 618.11 622.83 621.34 831488 50 615.48 619.81 618.76 835584 50 621.67 627.57 625.98 839680 49 624.01 639.62 636.00 843776 49 616.38 628.56 625.58 847872 49 596.65 615.98 612.72 851968 49 628.74 642.42 639.12 856064 48 646.14 651.21 647.88 860160 48 658.42 664.96 661.10 864256 48 656.70 663.28 659.35 868352 48 646.59 652.59 649.22 872448 48 649.89 658.82 654.46 876544 47 660.94 666.50 663.93 880640 47 660.64 668.35 665.57 884736 47 670.54 679.17 676.78 888832 47 674.44 682.17 679.78 892928 46 665.46 679.96 677.20 897024 46 681.13 694.95 692.52 901120 46 663.90 676.79 674.81 905216 46 696.36 709.95 707.10 909312 46 677.30 688.52 686.83 913408 45 686.58 691.29 688.86 917504 45 707.19 710.72 708.81 921600 45 696.86 700.94 698.63 925696 45 710.76 716.12 713.79 929792 45 712.11 715.75 713.99 933888 44 710.73 723.42 720.52 937984 44 709.58 722.80 720.06 942080 44 717.00 728.23 725.50 946176 44 721.60 731.52 729.63 950272 44 715.74 729.00 726.00 954368 43 712.98 720.62 718.39 958464 43 730.14 740.00 736.19 962560 43 728.64 737.62 734.80 966656 43 742.36 750.09 747.54 970752 43 732.23 742.02 738.44 974848 43 720.86 729.32 726.12 978944 42 739.15 752.85 749.01 983040 42 735.05 749.88 745.53 987136 42 753.45 763.93 760.95 991232 42 737.93 749.14 746.10 995328 42 744.94 756.28 753.36 999424 41 747.62 755.64 752.53 1003520 41 748.52 755.85 752.91 1007616 41 777.61 785.84 782.74 1011712 41 739.75 746.74 743.93 1015808 41 760.43 769.62 766.44 1019904 41 747.94 755.05 752.32 1024000 40 767.05 788.81 783.73 1028096 40 765.42 786.44 781.24 1032192 40 769.50 792.12 787.00 1036288 40 779.14 800.59 795.25 1040384 40 773.82 794.98 790.03 1044480 40 767.76 790.04 784.74 1048576 40 792.37 816.67 811.44 #---------------------------------------------------------------- # Benchmarking Scatterv # #processes = 12 #---------------------------------------------------------------- #bytes #repetitions t_min[usec] t_max[usec] t_avg[usec] 0 1000 0.03 0.04 0.04 4096 1000 5.16 5.16 5.16 8192 1000 5.80 5.82 5.81 12288 1000 7.04 7.05 7.05 16384 1000 8.01 8.02 8.02 20480 1000 10.12 10.14 10.13 24576 1000 10.63 10.65 10.64 28672 1000 12.76 12.78 12.77 32768 1000 10.84 10.86 10.85 36864 1000 11.74 11.79 11.77 40960 1000 13.11 13.15 13.13 45056 930 14.13 14.17 14.15 49152 853 15.71 15.81 15.77 53248 787 16.88 16.93 16.90 57344 731 19.31 19.42 19.37 61440 682 19.93 20.02 19.97 65536 640 20.99 21.25 21.18 69632 602 23.53 23.74 23.66 73728 568 29.00 29.17 29.11 77824 538 28.19 28.34 28.27 81920 512 34.72 34.81 34.79 86016 487 29.15 29.32 29.25 90112 465 41.62 41.95 41.86 94208 445 43.18 43.42 43.30 98304 426 35.13 35.44 35.33 102400 409 42.39 42.72 42.59 106496 393 45.72 46.07 45.93 110592 379 43.56 43.72 43.67 114688 365 37.07 37.56 37.42 118784 353 40.67 41.27 41.07 122880 341 46.34 46.87 46.68 126976 330 44.49 44.71 44.63 131072 320 47.20 47.53 47.38 135168 310 51.31 51.64 51.48 139264 301 70.90 71.73 71.48 143360 292 76.16 76.82 76.51 147456 284 69.28 69.48 69.39 151552 276 64.54 65.33 65.01 155648 269 50.44 51.35 51.00 159744 262 51.72 52.43 52.11 163840 256 128.81 129.06 128.96 167936 249 108.06 109.64 109.44 172032 243 51.71 52.79 52.33 176128 238 53.51 54.66 54.12 180224 232 61.73 62.95 62.54 184320 227 70.05 71.34 70.73 188416 222 77.86 78.75 78.47 192512 217 63.36 64.97 64.24 196608 213 95.41 96.62 96.06 200704 208 105.42 106.44 106.07 204800 204 141.41 143.61 143.19 208896 200 116.95 117.90 117.45 212992 196 123.62 124.76 124.29 217088 193 149.57 151.59 150.67 221184 189 128.88 130.37 129.95 225280 186 155.53 156.91 156.42 229376 182 141.85 143.43 142.85 233472 179 145.64 146.78 146.18 237568 176 117.40 119.07 118.34 241664 173 100.16 101.98 101.37 245760 170 101.58 104.09 103.14 249856 167 93.09 95.96 94.59 253952 165 97.28 99.95 98.79 258048 162 95.32 97.00 96.04 262144 160 102.02 103.62 102.96 266240 157 101.31 103.76 102.72 270336 155 112.89 115.16 114.02 274432 152 123.33 124.05 123.80 278528 150 120.57 122.17 121.47 282624 148 117.47 118.95 118.31 286720 146 117.19 119.90 118.82 290816 144 131.47 133.56 132.73 294912 142 132.08 134.35 133.19 299008 140 127.97 129.06 128.59 303104 138 126.55 128.48 127.92 307200 136 132.43 135.01 133.89 311296 134 112.62 115.38 114.45 315392 132 113.66 116.49 115.23 319488 131 150.19 152.15 151.02 323584 129 118.16 122.21 120.43 327680 128 150.82 152.13 151.46 331776 126 116.86 120.77 119.11 335872 124 123.67 124.85 124.39 339968 123 159.03 162.70 161.44 344064 121 147.70 151.85 150.05 348160 120 156.07 159.07 157.76 352256 119 161.93 163.45 162.67 356352 117 167.45 171.23 169.44 360448 116 140.90 142.05 141.60 364544 115 163.85 167.84 165.80 368640 113 157.39 159.95 158.85 372736 112 201.63 206.18 204.72 376832 111 188.25 192.18 190.81 380928 110 209.31 214.77 212.44 385024 108 204.49 208.98 207.00 389120 107 201.72 203.72 202.73 393216 106 217.46 220.92 219.70 397312 105 213.71 216.37 215.47 401408 104 219.70 220.93 220.35 405504 103 243.46 246.52 245.58 409600 102 248.85 252.55 251.75 413696 101 211.22 215.32 213.53 417792 100 248.73 250.69 250.13 421888 99 221.57 223.91 222.82 425984 98 245.73 251.19 248.64 430080 97 219.73 225.34 222.59 434176 96 256.12 260.07 258.71 438272 95 234.26 237.25 235.70 442368 94 205.41 208.49 207.07 446464 93 303.27 305.51 304.98 450560 93 293.47 295.76 295.24 454656 92 317.18 319.81 318.87 458752 91 318.51 322.63 321.00 462848 90 283.16 287.52 285.43 466944 89 343.94 347.12 345.55 471040 89 350.31 355.05 353.12 475136 88 269.32 274.83 273.17 479232 87 312.46 318.32 316.38 483328 86 322.35 331.27 328.94 487424 86 338.02 346.57 343.88 491520 85 311.36 317.91 315.23 495616 84 281.53 285.95 284.53 499712 83 279.61 283.64 282.42 503808 83 313.79 318.53 317.38 507904 82 253.56 258.10 256.73 512000 81 300.47 306.17 304.38 516096 81 279.71 282.85 281.86 520192 80 278.82 283.99 281.10 524288 80 279.13 283.28 281.18 528384 79 238.64 244.19 243.38 532480 78 224.57 229.77 228.18 536576 78 314.63 320.60 318.84 540672 77 292.56 298.49 296.53 544768 76 293.58 296.70 295.61 548864 76 301.24 305.23 303.33 552960 75 197.54 203.59 200.94 557056 75 265.83 272.09 270.10 561152 74 310.13 316.39 313.58 565248 74 280.48 288.87 285.40 569344 73 315.71 328.11 323.54 573440 73 303.71 310.04 308.28 577536 72 299.90 304.59 302.71 581632 72 306.95 313.52 310.25 585728 71 332.46 338.12 336.25 589824 71 315.59 321.46 319.32 593920 70 334.12 341.42 338.68 598016 70 335.18 342.46 339.60 602112 69 303.49 307.71 306.28 606208 69 333.61 339.60 337.30 610304 68 348.44 353.90 351.76 614400 68 405.21 409.61 407.58 618496 67 389.18 396.10 394.94 622592 67 335.23 342.94 341.41 626688 66 406.47 415.17 412.56 630784 66 376.91 385.72 383.65 634880 66 352.95 362.35 360.04 638976 65 382.78 391.40 387.29 643072 65 418.85 428.08 423.66 647168 64 422.19 428.02 426.04 651264 64 412.28 417.39 415.16 655360 64 445.42 455.20 450.92 659456 63 486.96 494.57 492.99 663552 63 468.62 477.54 475.11 667648 62 458.13 465.79 462.47 671744 62 488.52 497.60 494.53 675840 62 485.52 491.94 489.39 679936 61 439.90 449.34 446.62 684032 61 510.20 519.78 517.73 688128 60 490.23 495.33 494.61 692224 60 431.32 438.83 434.83 696320 60 482.96 487.14 485.91 700416 59 527.23 538.35 535.83 704512 59 429.15 436.63 433.95 708608 59 518.73 530.11 527.62 712704 58 496.30 504.86 503.34 716800 58 513.84 522.63 521.06 720896 58 481.69 492.08 490.23 724992 57 497.42 507.50 502.80 729088 57 519.57 523.56 522.47 733184 57 488.59 492.51 491.44 737280 56 574.71 582.55 579.89 741376 56 495.11 502.19 499.94 745472 56 548.45 555.57 552.80 749568 55 473.09 489.92 483.12 753664 55 426.84 439.60 435.97 757760 55 450.79 459.29 457.41 761856 55 474.16 484.42 482.42 765952 54 595.47 609.88 607.71 770048 54 420.08 432.01 428.94 774144 54 470.48 481.80 478.97 778240 53 515.23 526.96 523.70 782336 53 503.20 515.14 511.42 786432 53 406.68 424.12 415.82 790528 53 522.12 535.11 528.84 794624 52 508.64 519.81 515.56 798720 52 510.81 521.60 516.93 802816 52 491.44 504.34 499.85 806912 51 371.26 383.79 379.57 811008 51 461.40 477.22 470.48 815104 51 435.72 443.92 441.42 819200 51 614.20 630.34 627.16 823296 50 471.77 487.34 481.74 827392 50 545.14 557.58 554.21 831488 50 519.04 532.26 527.30 835584 50 608.71 628.45 622.41 839680 49 556.35 566.21 562.03 843776 49 510.94 521.19 519.22 847872 49 659.26 669.74 667.07 851968 49 464.54 475.85 471.77 856064 48 503.56 512.98 508.85 860160 48 519.86 524.98 523.81 864256 48 413.22 418.20 416.82 868352 48 664.17 669.61 668.47 872448 48 598.45 604.37 603.20 876544 47 670.38 686.89 682.02 880640 47 649.90 664.11 661.42 884736 47 683.54 695.61 693.24 888832 47 570.75 586.89 582.18 892928 46 611.48 626.12 623.44 897024 46 653.06 667.76 664.74 901120 46 701.43 716.20 713.53 905216 46 635.28 648.32 646.28 909312 46 680.31 694.74 691.63 913408 45 543.93 550.43 547.89 917504 45 409.43 422.30 417.47 921600 45 575.00 588.92 581.59 925696 45 788.63 796.49 794.74 929792 45 594.02 608.63 600.65 933888 44 603.44 615.34 610.34 937984 44 621.83 638.54 633.93 942080 44 750.37 763.66 760.85 946176 44 670.51 681.58 678.26 950272 44 547.01 560.12 557.22 954368 43 791.36 804.75 801.08 958464 43 771.52 783.27 780.79 962560 43 754.78 763.69 761.98 966656 43 748.23 759.83 757.13 970752 43 757.83 768.16 765.85 974848 43 737.71 746.70 744.98 978944 42 811.04 827.93 824.31 983040 42 798.75 815.68 811.28 987136 42 803.71 824.00 818.79 991232 42 766.06 785.57 780.72 995328 42 771.28 787.94 783.49 999424 41 715.55 736.50 731.18 1003520 41 668.86 684.48 678.38 1007616 41 679.91 702.19 696.39 1011712 41 762.51 779.70 775.23 1015808 41 716.18 737.07 731.36 1019904 41 656.44 674.19 669.01 1024000 40 717.68 741.48 736.64 1028096 40 715.98 739.66 732.01 1032192 40 759.40 786.58 780.91 1036288 40 748.99 771.34 766.49 1040384 40 679.67 702.13 691.61 1044480 40 761.20 775.54 772.32 1048576 40 672.40 693.50 688.79 #---------------------------------------------------------------- # Benchmarking Alltoall # #processes = 12 #---------------------------------------------------------------- #bytes #repetitions t_min[usec] t_max[usec] t_avg[usec] 0 1000 0.13 0.17 0.14 4096 1000 24.29 24.29 24.29 8192 1000 28.01 28.01 28.01 12288 1000 32.47 32.47 32.47 16384 1000 33.59 33.59 33.59 20480 1000 35.77 35.77 35.77 24576 1000 43.15 43.16 43.16 28672 1000 48.22 48.22 48.22 32768 1000 50.00 50.00 50.00 36864 1000 54.31 54.31 54.31 40960 1000 63.63 63.63 63.63 45056 930 65.25 65.25 65.25 49152 853 69.08 69.08 69.08 53248 787 77.15 77.16 77.16 57344 731 85.09 85.09 85.09 61440 682 88.27 88.27 88.27 65536 640 102.96 102.96 102.96 69632 602 101.21 101.21 101.21 73728 568 100.45 100.45 100.45 77824 538 103.83 103.83 103.83 81920 512 113.09 113.09 113.09 86016 487 120.71 120.72 120.72 90112 465 128.78 128.78 128.78 94208 445 137.88 137.88 137.88 98304 426 140.62 140.62 140.62 102400 409 148.12 148.12 148.12 106496 393 160.95 160.95 160.95 110592 379 163.42 163.42 163.42 114688 365 170.03 170.03 170.03 118784 353 175.57 175.57 175.57 122880 341 182.57 182.58 182.58 126976 330 188.86 188.86 188.86 131072 320 194.73 194.73 194.73 135168 310 324.64 324.73 324.69 139264 301 336.54 336.68 336.63 143360 292 346.18 346.26 346.22 147456 284 355.72 355.84 355.79 151552 276 366.29 366.42 366.35 155648 269 376.50 376.63 376.55 159744 262 384.38 384.47 384.45 163840 256 397.63 397.77 397.68 167936 249 407.74 407.94 407.84 172032 243 417.00 417.15 417.09 176128 238 427.72 427.86 427.81 180224 232 436.42 436.66 436.54 184320 227 448.38 448.56 448.49 188416 222 459.68 459.79 459.73 192512 217 468.23 468.43 468.32 196608 213 476.03 476.24 476.15 200704 208 490.64 490.84 490.76 204800 204 503.07 503.28 503.15 208896 200 518.05 518.27 518.19 212992 196 530.88 531.21 531.05 217088 193 544.68 544.95 544.83 221184 189 560.00 560.26 560.12 225280 186 574.44 574.70 574.59 229376 182 593.50 593.76 593.61 233472 179 611.45 611.73 611.63 237568 176 626.01 626.19 626.12 241664 173 642.32 642.66 642.50 245760 170 663.79 664.19 663.97 249856 167 682.38 682.58 682.53 253952 165 710.40 710.71 710.55 258048 162 735.46 735.72 735.62 262144 160 755.90 756.17 756.07 266240 157 772.59 772.96 772.77 270336 155 800.94 801.44 801.25 274432 152 822.62 823.14 822.92 278528 150 848.27 848.82 848.55 282624 148 874.35 874.88 874.68 286720 146 909.10 909.47 909.29 290816 144 936.03 936.48 936.27 294912 142 967.85 968.31 968.06 299008 140 987.36 988.12 987.74 303104 138 1018.26 1018.78 1018.51 307200 136 1047.82 1048.53 1048.31 311296 134 1075.97 1076.73 1076.47 315392 132 1112.98 1114.08 1113.60 319488 131 1145.52 1146.32 1145.91 323584 129 1168.60 1169.20 1168.98 327680 128 1201.73 1202.22 1202.05 331776 126 1221.44 1221.92 1221.75 335872 124 1240.32 1241.31 1240.99 339968 123 1274.83 1275.33 1275.03 344064 121 1306.81 1308.05 1307.49 348160 120 1326.01 1326.69 1326.43 352256 119 1360.84 1361.99 1361.55 356352 117 1388.11 1389.27 1388.78 360448 116 1418.52 1419.40 1419.00 364544 115 1432.14 1433.19 1432.60 368640 113 1455.77 1456.86 1456.41 372736 112 1488.92 1489.59 1489.25 376832 111 1519.98 1520.96 1520.54 380928 110 1540.24 1541.46 1540.65 385024 108 1566.93 1568.25 1567.78 389120 107 1608.10 1609.49 1608.89 393216 106 1639.41 1640.65 1639.98 397312 105 1665.65 1667.16 1666.46 401408 104 1679.70 1681.24 1680.39 405504 103 1703.21 1704.50 1703.74 409600 102 1731.84 1733.36 1732.79 413696 101 1757.10 1758.68 1758.20 417792 100 1791.83 1792.65 1792.43 421888 99 1811.01 1812.82 1811.96 425984 98 1845.49 1846.37 1845.95 430080 97 1858.74 1860.53 1859.75 434176 96 1890.80 1892.57 1891.63 438272 95 1928.01 1930.16 1928.92 442368 94 1952.12 1953.96 1953.32 446464 93 1970.92 1972.92 1972.08 450560 93 2001.13 2002.98 2002.38 454656 92 2053.74 2054.93 2054.53 458752 91 2053.58 2055.46 2054.85 462848 90 2064.91 2066.99 2066.19 466944 89 2105.76 2106.94 2106.61 471040 89 2124.19 2126.27 2125.73 475136 88 2143.37 2146.04 2144.67 479232 87 2162.80 2165.01 2164.22 483328 86 2193.10 2195.42 2194.45 487424 86 2222.33 2224.47 2223.61 491520 85 2245.51 2247.78 2246.81 495616 84 2264.27 2266.69 2265.59 499712 83 2297.59 2298.82 2298.21 503808 83 2324.08 2326.55 2325.43 507904 82 2338.74 2340.20 2339.59 512000 81 2357.49 2360.21 2359.20 516096 81 2396.27 2398.51 2397.56 520192 80 2419.65 2421.54 2420.90 524288 80 2446.80 2448.66 2448.01 528384 79 2460.58 2463.44 2462.36 532480 78 2499.74 2501.88 2501.07 536576 78 2527.58 2530.36 2529.26 540672 77 2550.60 2553.54 2552.46 544768 76 2576.84 2579.89 2578.53 548864 76 2603.65 2606.68 2605.54 552960 75 2623.89 2627.07 2625.86 557056 75 2652.79 2655.72 2654.59 561152 74 2682.20 2684.79 2683.82 565248 74 2722.67 2725.72 2724.60 569344 73 2728.16 2731.28 2730.08 573440 73 2742.79 2745.89 2744.71 577536 72 2776.87 2779.22 2778.00 581632 72 2804.44 2807.71 2806.23 585728 71 2826.72 2828.82 2827.78 589824 71 2855.19 2857.14 2856.18 593920 70 2861.44 2863.36 2862.37 598016 70 2901.07 2904.55 2903.45 602112 69 2908.33 2911.63 2909.94 606208 69 2918.85 2922.02 2920.78 610304 68 2932.07 2935.01 2933.94 614400 68 2956.48 2958.60 2957.65 618496 67 2989.40 2993.93 2992.30 622592 67 3008.66 3013.65 3011.71 626688 66 3123.22 3128.57 3126.57 630784 66 3132.74 3136.20 3134.57 634880 66 3139.95 3144.06 3141.93 638976 65 3145.90 3148.27 3147.30 643072 65 3191.78 3195.47 3193.37 647168 64 3155.31 3159.27 3157.40 651264 64 3204.22 3210.18 3207.88 655360 64 3274.53 3278.47 3276.69 659456 63 3298.79 3302.84 3300.55 663552 63 3327.83 3332.12 3330.57 667648 62 3331.84 3336.30 3334.16 671744 62 3328.07 3333.40 3330.91 675840 62 3350.23 3353.51 3352.07 679936 61 3407.12 3411.74 3409.33 684032 61 3407.92 3412.50 3410.26 688128 60 3393.44 3400.45 3397.87 692224 60 3465.97 3470.74 3468.36 696320 60 3465.33 3469.64 3467.53 700416 59 3502.07 3507.33 3504.72 704512 59 3531.84 3536.15 3534.66 708608 59 3508.88 3513.87 3511.41 712704 58 3576.64 3582.16 3579.38 716800 58 3560.73 3568.17 3565.12 720896 58 3607.00 3611.52 3609.08 724992 57 3602.40 3609.18 3606.28 729088 57 3661.24 3668.48 3665.19 733184 57 3612.96 3619.34 3616.26 737280 56 3667.47 3674.20 3671.02 741376 56 3602.82 3607.26 3605.22 745472 56 3737.13 3747.40 3742.73 749568 55 3673.48 3681.48 3678.47 753664 55 3825.42 3831.05 3828.30 757760 55 3748.66 3756.90 3753.14 761856 55 3789.39 3797.67 3794.02 765952 54 3804.18 3807.46 3805.73 770048 54 3823.83 3831.90 3827.87 774144 54 3844.60 3847.64 3846.50 778240 53 3869.17 3875.36 3871.88 782336 53 3882.07 3887.15 3884.86 786432 53 3884.21 3892.39 3888.45 790528 53 4058.12 4066.23 4062.35 794624 52 4005.08 4013.57 4008.88 798720 52 4001.19 4010.81 4006.70 802816 52 4109.37 4119.57 4114.90 806912 51 4190.38 4199.81 4195.14 811008 51 4086.84 4096.73 4092.31 815104 51 4179.90 4187.80 4183.29 819200 51 4240.29 4248.77 4244.10 823296 50 4295.11 4305.41 4299.69 827392 50 4269.16 4273.48 4271.34 831488 50 4221.24 4227.71 4225.51 835584 50 4202.93 4213.37 4207.92 839680 49 4301.87 4312.94 4307.44 843776 49 4240.76 4245.77 4242.52 847872 49 4237.37 4248.74 4243.00 851968 49 4386.29 4397.35 4391.74 856064 48 4330.26 4340.75 4336.84 860160 48 4337.26 4346.63 4342.75 864256 48 4284.38 4293.92 4288.52 868352 48 4421.93 4427.71 4424.71 872448 48 4308.80 4315.74 4312.34 876544 47 4500.36 4504.72 4502.39 880640 47 4449.98 4460.16 4455.64 884736 47 4425.76 4432.52 4429.34 888832 47 4380.07 4388.43 4384.78 892928 46 4518.55 4524.44 4521.96 897024 46 4531.13 4543.30 4537.25 901120 46 4638.43 4648.72 4643.30 905216 46 4574.34 4584.03 4580.22 909312 46 4558.64 4570.89 4565.60 913408 45 4595.94 4602.55 4599.73 917504 45 4585.00 4598.26 4592.49 921600 45 4627.41 4632.08 4630.40 925696 45 4648.55 4659.04 4653.51 929792 45 4684.06 4691.47 4688.99 933888 44 4691.65 4700.98 4697.54 937984 44 4754.08 4765.16 4760.74 942080 44 4737.66 4748.35 4743.41 946176 44 4731.76 4741.63 4736.54 950272 44 4819.51 4826.88 4823.23 954368 43 4801.04 4809.63 4807.58 958464 43 4851.44 4857.02 4852.91 962560 43 4838.21 4843.51 4841.45 966656 43 4888.42 4897.94 4893.95 970752 43 4870.12 4875.51 4871.59 974848 43 4902.40 4912.49 4908.73 978944 42 4970.70 4985.84 4976.72 983040 42 5005.32 5011.94 5009.95 987136 42 5025.02 5031.32 5029.38 991232 42 5040.51 5045.84 5043.37 995328 42 5075.27 5085.88 5080.19 999424 41 5080.01 5086.01 5083.44 1003520 41 5096.52 5106.27 5101.60 1007616 41 5163.98 5170.96 5166.24 1011712 41 5131.97 5141.64 5137.16 1015808 41 5144.81 5155.80 5150.85 1019904 41 5169.17 5178.85 5174.32 1024000 40 5188.42 5194.69 5192.35 1028096 40 5225.46 5235.24 5230.80 1032192 40 5219.44 5232.52 5226.04 1036288 40 5252.46 5262.05 5256.98 1040384 40 5280.30 5290.78 5284.11 1044480 40 5315.43 5325.24 5320.63 1048576 40 5310.82 5321.29 5317.06 #---------------------------------------------------------------- # Benchmarking Alltoallv # #processes = 12 #---------------------------------------------------------------- #bytes #repetitions t_min[usec] t_max[usec] t_avg[usec] 0 1000 5.57 5.57 5.57 4096 1000 23.86 23.88 23.87 8192 1000 48.59 48.60 48.60 12288 1000 56.50 56.51 56.51 16384 1000 66.92 66.94 66.93 20480 1000 80.32 80.34 80.34 24576 1000 86.06 86.08 86.07 28672 1000 90.27 90.30 90.28 32768 1000 83.70 83.72 83.71 36864 1000 92.75 92.76 92.76 40960 1000 99.71 99.72 99.71 45056 930 107.58 107.60 107.59 49152 853 117.36 117.39 117.38 53248 787 116.98 117.00 116.99 57344 731 126.41 126.42 126.42 61440 682 134.52 134.54 134.53 65536 640 139.87 139.92 139.90 69632 602 152.63 152.68 152.66 73728 568 160.92 160.95 160.94 77824 538 172.86 172.92 172.89 81920 512 185.85 185.89 185.87 86016 487 199.08 199.12 199.10 90112 465 206.18 206.27 206.21 94208 445 217.67 217.73 217.71 98304 426 230.89 231.00 230.94 102400 409 240.17 240.28 240.23 106496 393 250.41 250.54 250.49 110592 379 260.09 260.25 260.18 114688 365 270.56 270.67 270.63 118784 353 278.44 278.58 278.51 122880 341 288.09 288.29 288.19 126976 330 298.93 298.97 298.95 131072 320 313.32 313.45 313.39 135168 310 319.94 320.04 320.01 139264 301 328.38 328.49 328.42 143360 292 336.49 336.66 336.57 147456 284 347.68 347.97 347.80 151552 276 359.14 359.42 359.30 155648 269 368.30 368.56 368.46 159744 262 377.46 377.67 377.54 163840 256 389.54 389.86 389.71 167936 249 398.04 398.34 398.25 172032 243 409.81 410.05 409.92 176128 238 414.60 415.01 414.84 180224 232 428.26 428.44 428.35 184320 227 437.75 438.18 437.99 188416 222 444.84 445.02 444.90 192512 217 456.02 456.43 456.22 196608 213 465.99 466.39 466.26 200704 208 475.58 476.13 475.93 204800 204 488.23 488.77 488.52 208896 200 502.42 503.04 502.68 212992 196 516.77 517.28 517.09 217088 193 532.49 532.95 532.74 221184 189 548.26 548.60 548.49 225280 186 570.58 571.41 571.12 229376 182 585.28 585.95 585.66 233472 179 603.97 604.38 604.12 237568 176 620.46 620.85 620.63 241664 173 634.11 634.66 634.45 245760 170 656.46 656.93 656.75 249856 167 684.50 684.97 684.79 253952 165 710.70 711.00 710.85 258048 162 724.77 726.09 725.47 262144 160 755.57 756.63 756.16 266240 157 778.53 779.76 779.19 270336 155 789.16 790.66 790.02 274432 152 821.75 823.07 822.54 278528 150 846.74 847.51 847.17 282624 148 874.47 875.46 875.11 286720 146 901.77 902.92 902.29 290816 144 926.56 927.64 926.97 294912 142 944.52 945.91 945.18 299008 140 994.25 995.00 994.78 303104 138 1016.69 1017.88 1017.28 307200 136 1032.56 1033.54 1033.15 311296 134 1068.04 1069.63 1068.86 315392 132 1105.31 1106.49 1105.93 319488 131 1121.38 1122.58 1121.88 323584 129 1151.58 1152.42 1151.99 327680 128 1178.81 1179.68 1179.21 331776 126 1210.28 1211.99 1211.10 335872 124 1223.99 1227.14 1225.80 339968 123 1255.42 1257.29 1256.78 344064 121 1288.36 1290.20 1289.24 348160 120 1321.57 1323.13 1322.57 352256 119 1339.59 1341.18 1340.59 356352 117 1377.71 1379.18 1378.52 360448 116 1389.40 1390.97 1390.36 364544 115 1413.48 1416.39 1415.03 368640 113 1464.46 1465.57 1465.02 372736 112 1479.49 1482.55 1480.97 376832 111 1494.40 1496.86 1495.62 380928 110 1519.18 1520.87 1519.79 385024 108 1561.61 1564.89 1563.59 389120 107 1583.86 1587.24 1585.74 393216 106 1605.55 1607.60 1606.67 397312 105 1611.58 1614.42 1612.66 401408 104 1683.27 1685.14 1684.14 405504 103 1683.67 1687.45 1686.02 409600 102 1700.78 1703.19 1702.07 413696 101 1743.82 1747.90 1745.69 417792 100 1751.06 1754.44 1753.09 421888 99 1763.77 1767.72 1766.12 425984 98 1810.13 1812.65 1811.31 430080 97 1835.26 1838.87 1836.81 434176 96 1862.77 1865.41 1864.11 438272 95 1856.72 1859.38 1858.21 442368 94 1903.96 1906.62 1906.05 446464 93 1940.42 1945.33 1943.12 450560 93 1944.73 1948.08 1946.09 454656 92 1989.51 1991.56 1990.93 458752 91 1973.67 1977.44 1976.03 462848 90 2027.47 2031.62 2029.61 466944 89 2046.46 2048.45 2047.29 471040 89 2041.93 2045.47 2043.59 475136 88 2092.25 2096.99 2094.45 479232 87 2105.01 2108.21 2106.44 483328 86 2114.76 2118.56 2116.42 487424 86 2153.16 2156.51 2154.67 491520 85 2202.94 2207.65 2205.44 495616 84 2195.66 2199.81 2198.21 499712 83 2211.94 2214.74 2213.45 503808 83 2240.63 2247.90 2244.21 507904 82 2246.47 2250.49 2249.49 512000 81 2267.92 2274.74 2271.15 516096 81 2298.88 2302.10 2300.75 520192 80 2347.72 2351.76 2349.04 524288 80 2331.27 2334.56 2333.39 528384 79 2383.91 2389.69 2387.46 532480 78 2383.84 2388.06 2386.62 536576 78 2441.52 2447.28 2444.35 540672 77 2457.59 2464.89 2461.60 544768 76 2457.61 2460.12 2458.35 548864 76 2485.07 2492.21 2489.26 552960 75 2480.35 2487.03 2483.93 557056 75 2531.71 2537.78 2533.86 561152 74 2541.40 2547.42 2544.70 565248 74 2540.64 2542.50 2541.75 569344 73 2568.17 2574.27 2572.90 573440 73 2638.98 2642.82 2640.62 577536 72 2625.88 2630.98 2628.60 581632 72 2646.11 2659.57 2654.30 585728 71 2657.31 2666.49 2661.49 589824 71 2687.32 2690.82 2688.76 593920 70 2733.13 2741.76 2738.20 598016 70 2704.36 2709.58 2707.45 602112 69 2744.48 2751.57 2748.62 606208 69 2782.41 2786.63 2783.86 610304 68 2807.16 2810.95 2808.92 614400 68 2824.52 2831.97 2828.28 618496 67 2810.17 2822.76 2816.27 622592 67 2838.35 2844.22 2840.87 626688 66 2889.79 2897.71 2893.72 630784 66 2886.45 2898.53 2892.58 634880 66 2892.31 2900.07 2896.62 638976 65 2941.73 2950.15 2945.47 643072 65 2968.80 2978.09 2972.69 647168 64 3000.45 3008.34 3005.98 651264 64 2978.30 2988.82 2983.75 655360 64 3057.99 3068.06 3062.25 659456 63 3005.72 3011.99 3009.63 663552 63 3071.96 3076.70 3074.89 667648 62 3066.43 3075.97 3071.60 671744 62 3111.03 3119.45 3114.54 675840 62 3110.14 3116.82 3114.04 679936 61 3149.05 3164.94 3157.60 684032 61 3195.38 3205.08 3200.38 688128 60 3206.98 3221.42 3214.21 692224 60 3217.14 3224.68 3220.96 696320 60 3237.74 3249.60 3243.52 700416 59 3312.26 3324.42 3319.65 704512 59 3287.60 3302.38 3297.08 708608 59 3258.12 3263.33 3261.33 712704 58 3358.24 3373.56 3366.37 716800 58 3339.54 3355.56 3348.63 720896 58 3459.28 3474.55 3467.50 724992 57 3401.97 3413.04 3407.47 729088 57 3401.05 3412.15 3406.75 733184 57 3402.79 3411.21 3407.78 737280 56 3463.90 3475.18 3471.90 741376 56 3541.36 3548.78 3545.49 745472 56 3522.26 3530.59 3526.39 749568 55 3522.80 3532.86 3527.55 753664 55 3518.88 3533.33 3526.43 757760 55 3590.12 3598.72 3593.96 761856 55 3610.29 3620.39 3616.81 765952 54 3621.16 3633.35 3627.52 770048 54 3620.92 3627.19 3623.92 774144 54 3672.73 3678.16 3676.09 778240 53 3685.02 3694.03 3688.86 782336 53 3724.75 3734.30 3729.82 786432 53 3712.55 3724.04 3720.00 790528 53 3716.23 3723.19 3718.88 794624 52 3755.25 3767.38 3761.30 798720 52 3840.68 3850.61 3843.87 802816 52 3814.45 3825.88 3821.99 806912 51 3852.09 3865.61 3858.54 811008 51 3875.60 3889.04 3883.73 815104 51 3961.61 3975.47 3968.68 819200 51 3931.35 3941.50 3937.43 823296 50 3906.36 3922.24 3913.40 827392 50 3928.84 3942.51 3934.43 831488 50 4018.71 4035.73 4025.60 835584 50 4007.72 4018.32 4012.15 839680 49 4003.20 4024.76 4013.41 843776 49 4073.03 4083.93 4077.58 847872 49 4086.45 4104.34 4096.27 851968 49 4064.03 4074.66 4071.37 856064 48 4117.56 4133.06 4127.85 860160 48 4191.11 4202.42 4197.64 864256 48 4147.49 4163.55 4154.46 868352 48 4095.10 4107.87 4101.98 872448 48 4193.40 4204.31 4198.78 876544 47 4254.94 4271.13 4262.16 880640 47 4235.06 4249.04 4243.60 884736 47 4320.86 4327.53 4325.32 888832 47 4250.54 4266.26 4262.37 892928 46 4394.74 4403.70 4399.37 897024 46 4351.65 4360.61 4356.13 901120 46 4382.15 4395.10 4390.46 905216 46 4365.99 4382.12 4371.70 909312 46 4406.00 4415.90 4411.69 913408 45 4478.57 4487.77 4483.84 917504 45 4445.25 4452.86 4449.23 921600 45 4456.73 4474.69 4467.07 925696 45 4532.59 4559.09 4543.84 929792 45 4483.17 4504.20 4494.01 933888 44 4527.63 4541.40 4534.63 937984 44 4627.76 4641.74 4634.38 942080 44 4590.40 4612.65 4600.68 946176 44 4620.50 4633.79 4627.98 950272 44 4674.11 4687.88 4682.97 954368 43 4617.98 4641.88 4631.05 958464 43 4714.58 4739.82 4727.66 962560 43 4781.30 4795.07 4789.26 966656 43 4702.91 4726.83 4715.00 970752 43 4726.64 4741.09 4733.13 974848 43 4780.66 4807.74 4792.22 978944 42 4901.65 4922.83 4914.53 983040 42 4841.23 4865.70 4854.87 987136 42 4909.75 4929.39 4917.65 991232 42 4849.71 4873.54 4862.29 995328 42 4918.64 4945.03 4935.10 999424 41 4837.70 4852.96 4846.46 1003520 41 5019.57 5045.33 5032.19 1007616 41 4993.52 5020.93 5006.83 1011712 41 4996.86 5013.08 5004.64 1015808 41 5041.26 5066.64 5055.42 1019904 41 5063.81 5085.83 5073.55 1024000 40 5003.05 5020.77 5012.25 1028096 40 5112.59 5135.56 5121.72 1032192 40 5177.76 5207.21 5193.51 1036288 40 5145.85 5162.52 5153.64 1040384 40 5086.43 5099.56 5091.37 1044480 40 5229.14 5245.88 5240.53 1048576 40 5308.22 5327.36 5320.68 #---------------------------------------------------------------- # Benchmarking Bcast # #processes = 12 #---------------------------------------------------------------- #bytes #repetitions t_min[usec] t_max[usec] t_avg[usec] 0 1000 0.12 0.13 0.12 4096 1000 3.96 3.96 3.96 8192 1000 6.99 7.00 6.99 12288 1000 8.75 8.75 8.75 16384 1000 10.63 10.63 10.63 20480 1000 12.44 12.44 12.44 24576 1000 14.16 14.16 14.16 28672 1000 15.71 15.71 15.71 32768 1000 16.46 16.46 16.46 36864 1000 18.14 18.15 18.15 40960 1000 19.63 19.63 19.63 45056 930 21.21 21.22 21.22 49152 853 22.57 22.58 22.58 53248 787 24.28 24.28 24.28 57344 731 25.55 25.56 25.55 61440 682 27.16 27.17 27.17 65536 640 31.83 31.83 31.83 69632 602 33.56 33.57 33.57 73728 568 35.37 35.37 35.37 77824 538 37.09 37.09 37.09 81920 512 39.00 39.01 39.00 86016 487 40.65 40.65 40.65 90112 465 42.41 42.42 42.42 94208 445 44.03 44.04 44.04 98304 426 45.69 45.70 45.70 102400 409 47.29 47.30 47.30 106496 393 48.76 48.76 48.76 110592 379 50.72 50.73 50.72 114688 365 52.26 52.27 52.27 118784 353 53.97 53.97 53.97 122880 341 56.96 56.96 56.96 126976 330 57.57 57.58 57.57 131072 320 59.42 59.43 59.42 135168 310 61.42 61.42 61.42 139264 301 63.18 63.21 63.20 143360 292 64.72 64.73 64.73 147456 284 66.57 66.58 66.57 151552 276 68.51 68.52 68.52 155648 269 70.86 70.87 70.86 159744 262 71.61 71.62 71.62 163840 256 72.56 72.57 72.57 167936 249 74.53 74.54 74.54 172032 243 77.53 77.54 77.54 176128 238 78.97 78.98 78.98 180224 232 80.96 80.97 80.97 184320 227 83.19 83.19 83.19 188416 222 84.14 84.15 84.15 192512 217 86.03 86.05 86.05 196608 213 88.02 88.03 88.03 200704 208 90.05 90.06 90.06 204800 204 91.57 91.58 91.58 208896 200 92.35 92.36 92.35 212992 196 94.03 94.04 94.04 217088 193 96.79 96.82 96.81 221184 189 97.81 97.82 97.82 225280 186 99.91 99.93 99.92 229376 182 102.22 102.23 102.23 233472 179 104.56 104.57 104.57 237568 176 105.05 105.07 105.07 241664 173 107.42 107.43 107.42 245760 170 109.86 109.87 109.87 249856 167 111.87 111.87 111.87 253952 165 109.86 109.87 109.87 258048 162 112.43 112.44 112.44 262144 160 113.78 113.80 113.79 266240 157 116.71 116.72 116.72 270336 155 118.27 118.29 118.28 274432 152 121.25 121.26 121.26 278528 150 122.38 122.40 122.39 282624 148 123.44 123.45 123.45 286720 146 127.11 127.13 127.12 290816 144 129.51 129.52 129.52 294912 142 129.80 129.82 129.81 299008 140 130.28 130.29 130.28 303104 138 131.13 131.14 131.14 307200 136 134.83 134.84 134.84 311296 134 138.70 138.72 138.71 315392 132 140.40 140.41 140.41 319488 131 143.03 143.05 143.04 323584 129 144.02 144.04 144.03 327680 128 145.89 145.91 145.90 331776 126 146.45 146.47 146.46 335872 124 149.34 149.37 149.36 339968 123 151.78 151.80 151.80 344064 121 152.81 152.84 152.84 348160 120 155.73 155.74 155.74 352256 119 157.22 157.25 157.25 356352 117 158.56 158.57 158.57 360448 116 159.68 159.71 159.70 364544 115 162.00 162.02 162.01 368640 113 163.34 163.36 163.35 372736 112 166.12 166.13 166.13 376832 111 167.14 167.16 167.15 380928 110 172.63 172.64 172.64 385024 108 169.97 169.99 169.98 389120 107 170.76 170.77 170.77 393216 106 175.56 175.59 175.58 397312 105 176.22 176.24 176.23 401408 104 178.47 178.50 178.49 405504 103 179.96 179.97 179.97 409600 102 181.05 181.07 181.07 413696 101 182.38 182.39 182.39 417792 100 184.45 184.48 184.48 421888 99 187.18 187.20 187.20 425984 98 189.17 189.19 189.19 430080 97 191.37 191.40 191.40 434176 96 194.91 194.95 194.94 438272 95 196.19 196.20 196.20 442368 94 197.24 197.27 197.26 446464 93 199.27 199.28 199.28 450560 93 203.95 203.98 203.97 454656 92 201.13 201.15 201.15 458752 91 203.30 203.32 203.31 462848 90 204.51 204.53 204.52 466944 89 206.58 206.60 206.60 471040 89 209.21 209.24 209.23 475136 88 210.75 210.78 210.77 479232 87 213.50 213.51 213.50 483328 86 214.32 214.35 214.35 487424 86 218.42 218.44 218.43 491520 85 218.78 218.86 218.83 495616 84 222.00 222.02 222.01 499712 83 223.05 223.09 223.08 503808 83 226.21 226.24 226.23 507904 82 226.89 226.92 226.91 512000 81 228.32 228.34 228.33 516096 81 229.84 229.87 229.87 520192 80 230.97 230.99 230.98 524288 80 200.20 200.48 200.38 528384 79 202.54 202.86 202.73 532480 78 201.02 201.23 201.21 536576 78 202.05 202.15 202.14 540672 77 205.54 205.78 205.76 544768 76 206.82 207.02 206.99 548864 76 208.62 208.72 208.71 552960 75 210.43 210.56 210.54 557056 75 210.86 211.00 210.99 561152 74 214.06 214.27 214.25 565248 74 219.42 219.59 219.57 569344 73 216.00 216.06 216.03 573440 73 218.03 218.08 218.07 577536 72 221.79 221.87 221.85 581632 72 221.95 222.33 222.13 585728 71 225.23 225.28 225.27 589824 71 225.06 225.41 225.27 593920 70 224.55 224.56 224.55 598016 70 228.21 228.47 228.32 602112 69 227.64 228.02 227.88 606208 69 229.40 229.51 229.47 610304 68 230.82 230.99 230.92 614400 68 229.53 229.74 229.71 618496 67 220.74 220.88 220.79 622592 67 221.04 221.14 221.09 626688 66 220.02 220.08 220.07 630784 66 223.32 223.51 223.43 634880 66 224.84 224.95 224.93 638976 65 226.57 226.64 226.63 643072 65 236.57 236.76 236.74 647168 64 239.11 239.34 239.31 651264 64 240.36 240.56 240.53 655360 64 241.64 241.85 241.82 659456 63 244.14 244.42 244.30 663552 63 244.24 244.29 244.29 667648 62 245.40 245.69 245.57 671744 62 249.90 250.30 250.21 675840 62 250.05 250.19 250.17 679936 61 251.48 251.56 251.55 684032 61 251.66 251.85 251.82 688128 60 256.40 256.93 256.73 692224 60 257.31 257.46 257.42 696320 60 258.66 258.99 258.86 700416 59 258.98 259.06 259.03 704512 59 260.10 260.44 260.30 708608 59 264.18 264.63 264.39 712704 58 261.57 261.85 261.77 716800 58 264.23 264.36 264.31 720896 58 263.79 264.17 264.02 724992 57 263.04 263.15 263.12 729088 57 265.48 265.74 265.68 733184 57 267.21 267.50 267.42 737280 56 268.63 268.94 268.80 741376 56 269.35 269.77 269.69 745472 56 268.23 268.28 268.27 749568 55 269.74 269.89 269.84 753664 55 270.01 270.18 270.13 757760 55 272.92 273.09 273.03 761856 55 273.66 273.77 273.74 765952 54 274.30 274.58 274.56 770048 54 273.72 273.93 273.91 774144 54 277.02 277.06 277.05 778240 53 280.32 280.40 280.39 782336 53 279.38 279.49 279.48 786432 53 282.04 282.15 282.13 790528 53 282.86 283.11 283.02 794624 52 285.13 285.29 285.26 798720 52 285.19 285.37 285.35 802816 52 284.29 284.33 284.32 806912 51 289.15 289.38 289.35 811008 51 290.03 290.19 290.15 815104 51 291.79 291.98 291.96 819200 51 292.29 292.77 292.67 823296 50 293.87 294.12 294.10 827392 50 302.63 302.99 302.95 831488 50 298.08 298.26 298.23 835584 50 300.38 300.46 300.45 839680 49 300.33 300.39 300.38 843776 49 303.30 303.54 303.49 847872 49 303.92 304.10 304.05 851968 49 308.37 308.78 308.63 856064 48 307.36 307.63 307.56 860160 48 311.44 311.64 311.61 864256 48 311.67 311.87 311.84 868352 48 312.79 312.98 312.91 872448 48 313.33 313.81 313.66 876544 47 313.57 313.67 313.65 880640 47 316.75 316.82 316.81 884736 47 318.05 318.17 318.14 888832 47 311.10 311.19 311.18 892928 46 308.72 308.91 308.82 897024 46 309.81 310.11 310.01 901120 46 309.10 309.29 309.22 905216 46 316.13 316.21 316.17 909312 46 317.75 317.83 317.81 913408 45 317.17 317.49 317.42 917504 45 321.96 322.44 322.20 921600 45 323.56 323.65 323.63 925696 45 320.29 320.46 320.40 929792 45 326.80 326.88 326.85 933888 44 323.20 323.31 323.28 937984 44 325.80 326.15 325.99 942080 44 327.00 327.19 327.14 946176 44 327.09 327.26 327.22 950272 44 329.64 329.74 329.72 954368 43 327.48 327.68 327.63 958464 43 328.81 329.08 328.98 962560 43 339.05 339.30 339.20 966656 43 335.21 335.37 335.29 970752 43 335.69 335.80 335.78 974848 43 337.58 337.72 337.70 978944 42 334.23 334.37 334.34 983040 42 340.14 340.25 340.24 987136 42 341.07 341.38 341.27 991232 42 341.15 341.38 341.34 995328 42 339.14 339.42 339.37 999424 41 345.24 345.39 345.36 1003520 41 343.89 344.07 344.04 1007616 41 342.80 343.19 343.06 1011712 41 347.63 348.12 348.02 1015808 41 345.81 345.99 345.94 1019904 41 353.88 353.91 353.90 1024000 40 350.11 350.39 350.36 1028096 40 350.15 350.34 350.30 1032192 40 346.73 346.99 346.95 1036288 40 358.03 358.16 358.14 1040384 40 356.39 356.57 356.53 1044480 40 359.62 359.85 359.79 1048576 40 359.21 359.43 359.41 #--------------------------------------------------- # Benchmarking Barrier # #processes = 12 #--------------------------------------------------- #repetitions t_min[usec] t_max[usec] t_avg[usec] 1000 1.37 1.37 1.37 # All processes entering MPI_Finalize srun: Received task exit notification for 12 tasks of StepId=104.0 (status=0x0000). srun: rt03d: tasks 0-11: Completed real 8m34.416s user 0m0.153s sys 0m0.416s