Params:
- num_input_rows=200
- num_input_cols=101
- num_sums=100
- num_ops=10
- num_runs=50

Running tests:
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True

-----------------------
InferenceType: MARGINAL
-----------------------
CPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 21359    No      No    18269.25          112.92          11.81       True
            sum 28359   Yes      No    22969.15          151.99          11.45       True
            sum 42459   Yes     Yes    33431.10          304.00          28.25       True
  parallel_sums   529    No      No      391.66           17.49          15.99       True
  parallel_sums   599   Yes      No      425.47           18.04          16.16       True
  parallel_sums   820   Yes     Yes      585.55           36.76          34.32       True
GPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 21359    No      No    18685.71          250.54           9.92       True
            sum 28359   Yes      No    22969.67          165.92           9.76       True
            sum 42459   Yes     Yes    32933.35          328.44          16.44       True
  parallel_sums   529    No      No      387.04            7.05           4.93       True
  parallel_sums   599   Yes      No      429.44            8.03           4.93       True
  parallel_sums   820   Yes     Yes      588.44           10.66           6.74       True

-----------------------
InferenceType: MARGINAL-LOG
-----------------------
CPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 34499    No      No    26483.09          206.35          14.10       True
            sum 41499   Yes      No    32003.48          249.43          14.30       True
            sum 56599   Yes     Yes    44147.68          370.89          30.91       True
  parallel_sums   849    No      No      594.38           30.17          24.31       True
  parallel_sums   919   Yes      No      629.44           28.85          24.48       True
  parallel_sums  1110   Yes     Yes      766.91           45.07          38.86       True
GPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 34499    No      No    28077.86          228.55          15.60       True
            sum 41499   Yes      No    31769.98          262.18          15.06       True
            sum 56599   Yes     Yes    42109.18          431.81          23.65       True
  parallel_sums   849    No      No      600.56           10.79           6.62       True
  parallel_sums   919   Yes      No      654.79           11.20           6.55       True
  parallel_sums  1110   Yes     Yes      768.16           14.26           8.01       True

-----------------------
InferenceType: MPE
-----------------------
CPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 21359    No      No    19200.92          113.71          12.61       True
            sum 28359   Yes      No    22744.32          154.13          12.07       True
            sum 42459   Yes     Yes    32068.09          268.89          27.95       True
  parallel_sums   569    No      No      405.85           19.83          16.58       True
  parallel_sums   639   Yes      No      442.58           19.20          17.07       True
  parallel_sums   820   Yes     Yes      634.38           39.08          35.50       True
GPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 21359    No      No    17738.92          117.23          10.27       True
            sum 28359   Yes      No    21862.06          146.71          10.14       True
            sum 42459   Yes     Yes    32345.93          306.68          16.21       True
  parallel_sums   569    No      No      407.43            7.62           5.54       True
  parallel_sums   639   Yes      No      451.55            9.03           5.44       True
  parallel_sums   820   Yes     Yes     1761.72           10.46           6.74       True

-----------------------
InferenceType: MPE-LOG
-----------------------
CPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 22379    No      No    17761.16          106.70           8.03       True
            sum 29379   Yes      No    23628.21          135.37           7.92       True
            sum 44479   Yes     Yes    33464.99          250.24          24.62       True
  parallel_sums   599    No      No      425.25           19.34          16.98       True
  parallel_sums   669   Yes      No      457.63           18.53          17.03       True
  parallel_sums   860   Yes     Yes      588.04           35.84          31.82       True
GPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 22379    No      No    19508.32          120.77          10.52       True
            sum 29379   Yes      No    23957.77          153.75          10.37       True
            sum 44479   Yes     Yes    33483.55          303.14          17.26       True
  parallel_sums   599    No      No      419.89            8.00           5.48       True
  parallel_sums   669   Yes      No      460.07            8.04           5.46       True
  parallel_sums   860   Yes     Yes      599.73           11.13           6.96       True
