Params:
- num_input_rows=200
- num_input_cols=101
- num_sums=100
- num_ops=10
- num_runs=50

Running tests:
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> sum: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=No, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 101), indices=Yes, ivs=Yes, inference=MPE, log=True

-----------------------
InferenceType: MARGINAL
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum 16219    No      No     6810.71          595.86           52.66           1.28       True
            sum 18219   Yes      No     7782.77          649.47           57.36           1.42       True
            sum 31319   Yes     Yes    12615.78         1110.19          209.62          11.79       True
  parallel_sums   339    No      No      151.73           14.41            4.44           0.32       True
  parallel_sums   359   Yes      No      149.38           12.81            1.45           0.53       True
  parallel_sums   550   Yes     Yes      203.81           17.30           33.70          16.26       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum 16219    No      No     7141.31          943.09          449.77           2.74       True
            sum 18219   Yes      No     7786.65          659.34           64.48           2.50       True
            sum 31319   Yes     Yes    12499.40         1117.33          183.62          10.83       True
  parallel_sums   339    No      No      135.06           11.99            4.01           0.36       True
  parallel_sums   359   Yes      No      151.34           13.13            1.99           0.43       True
  parallel_sums   550   Yes     Yes      206.79           16.99            5.18           0.97       True

-----------------------
InferenceType: MARGINAL-LOG
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum 29359    No      No    11757.11          949.91          137.25           5.34       True
            sum 31359   Yes      No    12085.25         1058.32          130.29           5.50       True
            sum 45459   Yes     Yes    17407.69         1565.34          240.97          15.48       True
  parallel_sums   659    No      No      261.96           21.61           18.11           9.53       True
  parallel_sums   679   Yes      No      255.19           20.89           13.86           9.14       True
  parallel_sums   840   Yes     Yes      337.36           26.74           33.85          17.79       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum 29359    No      No    11863.27          995.41          134.18          11.32       True
            sum 31359   Yes      No    12235.91         1057.23          141.04           9.62       True
            sum 45459   Yes     Yes    17533.86         1542.41          272.76          19.84       True
  parallel_sums   659    No      No      246.14           19.37            3.68           1.06       True
  parallel_sums   679   Yes      No      241.35           20.13            3.84           1.13       True
  parallel_sums   840   Yes     Yes      325.25           23.84            5.49           1.54       True

-----------------------
InferenceType: MPE
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum 16219    No      No     7376.34          566.95          100.09           4.77       True
            sum 18219   Yes      No     7569.81          644.66           93.30           4.65       True
            sum 31319   Yes     Yes    12357.81         1099.62          155.52          14.43       True
  parallel_sums   379    No      No      165.58           15.80            9.91           6.65       True
  parallel_sums   399   Yes      No      169.07           14.74            9.29           6.37       True
  parallel_sums   550   Yes     Yes      232.16           19.15           22.85          15.74       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum 16219    No      No     7028.54          593.20           55.70           3.09       True
            sum 18219   Yes      No     7553.62          653.48           61.93           2.62       True
            sum 31319   Yes     Yes    12251.52         1103.08          175.87          10.93       True
  parallel_sums   379    No      No      619.24           12.19            2.10           0.81       True
  parallel_sums   399   Yes      No      180.89           13.56            2.42           0.77       True
  parallel_sums   550   Yes     Yes      229.09           17.89            3.97           1.20       True

-----------------------
InferenceType: MPE-LOG
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum 17239    No      No     7032.53          584.49           53.99           1.93       True
            sum 19239   Yes      No     7851.36          667.73           64.34           2.20       True
            sum 33339   Yes     Yes    13028.69         1151.10          160.07          12.38       True
  parallel_sums   409    No      No      175.90           16.02            8.96           6.25       True
  parallel_sums   429   Yes      No      178.19           15.37            9.22           6.01       True
  parallel_sums   590   Yes     Yes      242.49           19.95           20.63          14.30       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum 17239    No      No     7414.02          626.54           59.74           3.36       True
            sum 19239   Yes      No     7869.82          679.49           68.06           4.06       True
            sum 33339   Yes     Yes    13159.98         1157.77          194.76          14.13       True
  parallel_sums   409    No      No      159.62           13.74            2.29           0.72       True
  parallel_sums   429   Yes      No      204.45           14.71            2.54           0.72       True
  parallel_sums   590   Yes     Yes      243.84           19.50            3.87           0.99       True
