Params:
- num_input_rows=200
- num_input_cols=101
- num_sums=100
- num_ops=10
- num_runs=50

Running tests:
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True

-----------------------
InferenceType: MARGINAL
-----------------------
CPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 24389    No      No     9896.21          207.84          21.80       True
            sum 31389   Yes      No    12486.79          166.98          21.91       True
            sum 45489   Yes     Yes    17850.57          358.42          33.00       True
  parallel_sums   619    No      No      889.78           41.21          36.37      False
  parallel_sums   689   Yes      No      286.13           43.03          37.61      False
  parallel_sums   910   Yes     Yes      392.91           60.12          54.28       True
GPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 24389    No      No    10512.69          426.77          12.24       True
            sum 31389   Yes      No    12737.57          152.16          11.74       True
            sum 45489   Yes     Yes    17746.68          282.42          18.12       True
  parallel_sums   619    No      No      349.68            5.48           3.74       True
  parallel_sums   689   Yes      No      251.71            5.45           2.97       True
  parallel_sums   910   Yes     Yes      330.51            7.21           4.18       True

-----------------------
InferenceType: MARGINAL-LOG
-----------------------
CPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 37529    No      No    14616.81          203.26          23.76       True
            sum 44529   Yes      No    16996.30          318.05          23.89       True
            sum 59629   Yes     Yes    22590.90          421.76          33.84       True
  parallel_sums   939    No      No      393.04           50.27          43.19       True
  parallel_sums  1009   Yes      No      407.81           55.44          43.66       True
  parallel_sums  1200   Yes     Yes      502.00           69.25          56.90       True
GPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 37529    No      No    15126.83          213.63          21.56       True
            sum 44529   Yes      No    17505.30          245.31          21.23       True
            sum 59629   Yes     Yes    22662.56          369.78          30.42       True
  parallel_sums   939    No      No      383.16            7.71           4.23       True
  parallel_sums  1009   Yes      No      407.03            8.09           4.21       True
  parallel_sums  1200   Yes     Yes     1642.39            8.95           4.44       True

-----------------------
InferenceType: MPE
-----------------------
CPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 24389    No      No     9786.86          134.85          22.36       True
            sum 31389   Yes      No    12412.97          168.16          23.17       True
            sum 45489   Yes     Yes    17741.93          273.52          32.91       True
  parallel_sums   659    No      No      287.21           43.87          39.80       True
  parallel_sums   729   Yes      No      311.09           37.28          39.93       True
  parallel_sums   910   Yes     Yes      412.48           54.05          52.65       True
GPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 24389    No      No    10340.94          125.14          13.90       True
            sum 31389   Yes      No    12422.89          151.64          13.43       True
            sum 45489   Yes     Yes    17782.49          276.43          18.65       True
  parallel_sums   659    No      No      280.02            9.88           3.63       True
  parallel_sums   729   Yes      No      346.40            6.39           3.69       True
  parallel_sums   910   Yes     Yes      329.72            7.17           3.98       True

-----------------------
InferenceType: MPE-LOG
-----------------------
CPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 25409    No      No    10665.72          139.71          20.45       True
            sum 32409   Yes      No    12688.54          166.47          20.45       True
            sum 47509   Yes     Yes    18429.60          276.59          31.83       True
  parallel_sums   689    No      No      296.59           38.98          37.78       True
  parallel_sums   759   Yes      No      345.45           37.53          39.73       True
  parallel_sums   950   Yes     Yes      397.09           54.06          50.14       True
GPU          op  size indices   ivs  setup_time  first_run_time  rest_run_time    correct
            sum 25409    No      No    10462.40          122.30          14.36       True
            sum 32409   Yes      No    12813.82          161.85          14.66       True
            sum 47509   Yes     Yes    18295.80          302.15          21.81       True
  parallel_sums   689    No      No      288.62            5.89           3.80       True
  parallel_sums   759   Yes      No     1144.04            5.90           3.33       True
  parallel_sums   950   Yes     Yes      338.29            7.46           4.18       True
