Params:
- num_input_rows=200
- num_input_cols=101
- num_sums=100
- num_ops=10
- num_runs=50

Running tests:
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True

-----------------------
InferenceType: MARGINAL
-----------------------
CPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 24389    No      No    10473.33          155.37          22.26       True
            sum 31389   Yes      No    13325.67          165.10          21.91       True
            sum 45489   Yes     Yes    19168.01          275.26          33.04       True
  parallel_sums   619    No      No      288.19           38.47          36.82      False
  parallel_sums   689   Yes      No      308.94           36.86          38.44      False
  parallel_sums   910   Yes     Yes      407.11           58.79          52.49       True
GPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 24389    No      No    11110.82          320.54          12.94       True
            sum 31389   Yes      No    13418.78          153.33          13.97       True
            sum 45489   Yes     Yes    18988.86          290.27          19.22       True
  parallel_sums   619    No      No      280.56            5.24           3.09       True
  parallel_sums   689   Yes      No      350.67            5.58           3.03       True
  parallel_sums   910   Yes     Yes      410.32            7.18           3.44       True

-----------------------
InferenceType: MARGINAL-LOG
-----------------------
CPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 37529    No      No    16016.17          199.96          23.47       True
            sum 44529   Yes      No    17999.52          235.19          23.80       True
            sum 59629   Yes     Yes    24000.28          354.82          34.16       True
  parallel_sums   939    No      No      411.27           47.62          41.99       True
  parallel_sums  1009   Yes      No      434.98           51.38          44.84       True
  parallel_sums  1200   Yes     Yes      511.16           60.88          54.01       True
GPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 37529    No      No    16067.73          201.35          18.68       True
            sum 44529   Yes      No    18115.82          230.25          16.45       True
            sum 59629   Yes     Yes    24158.44          386.49          26.02       True
  parallel_sums   939    No      No      407.49            7.06           3.70       True
  parallel_sums  1009   Yes      No      372.90            6.94           3.09       True
  parallel_sums  1200   Yes     Yes      444.54            8.35           3.89       True

-----------------------
InferenceType: MPE
-----------------------
CPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 24389    No      No    11046.65          212.45          22.15       True
            sum 31389   Yes      No    12946.15          198.09          22.32       True
            sum 45489   Yes     Yes    18269.49          264.47          33.20       True
  parallel_sums   659    No      No      268.46           34.83          37.89       True
  parallel_sums   729   Yes      No      328.90           42.60          37.53       True
  parallel_sums   910   Yes     Yes      395.59           63.93          52.49       True
GPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 24389    No      No    10835.51          113.48          10.96       True
            sum 31389   Yes      No    12989.06          139.66          12.20       True
            sum 45489   Yes     Yes    18588.08          263.92          18.92       True
  parallel_sums   659    No      No      291.48            5.57           3.21       True
  parallel_sums   729   Yes      No      311.25            5.26           3.12       True
  parallel_sums   910   Yes     Yes      426.05            7.26           3.72       True

-----------------------
InferenceType: MPE-LOG
-----------------------
CPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 25409    No      No    11178.00          130.49          20.09       True
            sum 32409   Yes      No    13136.03          164.22          20.25       True
            sum 47509   Yes     Yes    19124.98          351.68          30.52       True
  parallel_sums   689    No      No      304.71           37.48          37.12       True
  parallel_sums   759   Yes      No      333.27           40.36          37.71       True
  parallel_sums   950   Yes     Yes      422.37           48.61          49.75       True
GPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 25409    No      No    10798.69          120.97          11.31       True
            sum 32409   Yes      No    13227.79          149.99          13.45       True
            sum 47509   Yes     Yes    19022.92          285.82          23.23       True
  parallel_sums   689    No      No     1080.11            4.95           2.90       True
  parallel_sums   759   Yes      No      281.98            5.49           3.15       True
  parallel_sums   950   Yes     Yes      393.09            6.87           3.56       True
