Params:
- num_input_rows=200
- num_input_cols=101
- num_sums=100
- num_ops=10
- num_runs=50

Running tests:
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True

-----------------------
InferenceType: MARGINAL
-----------------------
CPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 21359    No      No     9501.53          117.97          10.36       True
            sum 28359   Yes      No    12103.61          147.83           9.52       True
            sum 42459   Yes     Yes    17798.45          324.08          21.90       True
           sums   639    No      No      395.28           16.80          14.76       True
           sums  7639   Yes      No     3675.40           46.91          12.59       True
           sums  7780   Yes     Yes     3040.58           63.94          22.62       True
  parallel_sums   529    No      No      228.65           16.85          18.82       True
  parallel_sums   599   Yes      No      282.28           22.09          18.15       True
  parallel_sums   820   Yes     Yes      325.11           43.89          37.39       True
GPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 21359    No      No    10269.70          295.97          12.35       True
            sum 28359   Yes      No    12304.22          168.56          13.26       True
            sum 42459   Yes     Yes    17842.85          387.18          18.82       True
           sums   639    No      No      404.36            7.82           2.73       True
           sums  7639   Yes      No     3215.33           36.62           2.74       True
           sums  7780   Yes     Yes     2969.23           36.05           3.21       True
  parallel_sums   529    No      No      250.26            5.00           2.89       True
  parallel_sums   599   Yes      No      244.50            4.85           2.77       True
  parallel_sums   820   Yes     Yes      331.17            6.60           3.18       True

-----------------------
InferenceType: MARGINAL-LOG
-----------------------
CPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 34499    No      No    14345.56          192.70          11.62       True
            sum 41499   Yes      No    17090.85          301.16          11.81       True
            sum 56599   Yes     Yes    23215.44          382.09          25.35       True
           sums   919    No      No      493.39           19.78          14.99       True
           sums  7919   Yes      No     4000.03           48.16          15.58       True
           sums  8070   Yes     Yes     3115.32           71.82          32.15       True
  parallel_sums   849    No      No      336.60           31.48          25.95       True
  parallel_sums   919   Yes      No      361.12           27.35          23.09       True
  parallel_sums  1110   Yes     Yes      438.50           50.65          38.15       True
GPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 34499    No      No    15177.23          243.43          17.30       True
            sum 41499   Yes      No    17637.57          325.24          18.86       True
            sum 56599   Yes     Yes    23256.66          479.15          25.21       True
           sums   919    No      No      625.77            8.99           3.47       True
           sums  7919   Yes      No     2993.45           38.12           3.03       True
           sums  8070   Yes     Yes     3144.26           72.75           3.56       True
  parallel_sums   849    No      No      335.32            6.92           3.03       True
  parallel_sums   919   Yes      No      351.26            6.59           2.95       True
  parallel_sums  1110   Yes     Yes      429.33            8.19           3.65       True

-----------------------
InferenceType: MPE
-----------------------
CPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 21359    No      No     9530.56          109.78           9.59       True
            sum 28359   Yes      No    12102.82          197.26           9.92       True
            sum 42459   Yes     Yes    17995.33          281.26          22.99       True
           sums   639    No      No      431.64           27.58          15.33       True
           sums  7639   Yes      No     3590.95           44.32          14.46       True
           sums  7780   Yes     Yes     2998.67           58.87          25.64       True
  parallel_sums   569    No      No      238.44           17.71          19.09       True
  parallel_sums   639   Yes      No      290.76           19.07          19.67       True
  parallel_sums   820   Yes     Yes      358.18           50.69          38.78       True
GPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 21359    No      No    10026.24          126.90          14.00       True
            sum 28359   Yes      No    12195.26          169.22          12.95       True
            sum 42459   Yes     Yes    17876.99          316.39          17.76       True
           sums   639    No      No      542.13            7.18           2.93       True
           sums  7639   Yes      No     2850.10           63.14           3.07       True
           sums  7780   Yes     Yes     3020.83           34.29           3.27       True
  parallel_sums   569    No      No      234.74            4.60           2.76       True
  parallel_sums   639   Yes      No      259.29            5.66           3.03       True
  parallel_sums   820   Yes     Yes      319.02            7.11           3.41       True

-----------------------
InferenceType: MPE-LOG
-----------------------
CPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 22379    No      No     9874.21          109.21           7.22       True
            sum 29379   Yes      No    12451.56          236.38           7.34       True
            sum 44479   Yes     Yes    18821.03          270.16          19.79       True
           sums   669    No      No      401.38           13.98           7.53       True
           sums  7669   Yes      No     3701.69           54.54           7.57       True
           sums  7820   Yes     Yes     3072.25           61.31          21.92       True
  parallel_sums   599    No      No      251.43           20.19          17.51       True
  parallel_sums   669   Yes      No      269.59           23.79          18.49       True
  parallel_sums   860   Yes     Yes      341.16           40.82          30.19       True
GPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 22379    No      No    10140.44          184.40          11.92       True
            sum 29379   Yes      No    12618.36          164.13          12.78       True
            sum 44479   Yes     Yes    18729.78          330.90          18.86       True
           sums   669    No      No      399.27            7.84           3.05       True
           sums  7669   Yes      No     3049.91           32.99           2.80       True
           sums  7820   Yes     Yes     3008.46           36.49           3.42       True
  parallel_sums   599    No      No      238.83            5.39           2.70       True
  parallel_sums   669   Yes      No      311.91            5.84           2.87       True
  parallel_sums   860   Yes     Yes      327.80            6.75           3.24       True
