Params:
- num_input_rows=200
- num_input_cols=100
- num_sums=100
- num_ops=10
- num_runs=50

Running tests:
--> sum: on_gpu=False, inputs_shape=(200, 100), indices=No, ivs=No, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 100), indices=Yes, ivs=No, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 100), indices=Yes, ivs=Yes, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 100), indices=No, ivs=No, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 100), indices=Yes, ivs=No, inference=MPE, log=False
--> sum: on_gpu=True, inputs_shape=(200, 100), indices=Yes, ivs=Yes, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 100), indices=No, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 100), indices=Yes, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 100), indices=Yes, ivs=Yes, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 100), indices=No, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 100), indices=Yes, ivs=No, inference=MPE, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 100), indices=Yes, ivs=Yes, inference=MPE, log=False
--> sum: on_gpu=False, inputs_shape=(200, 100), indices=No, ivs=No, inference=MPE, log=True
--> sum: on_gpu=False, inputs_shape=(200, 100), indices=Yes, ivs=No, inference=MPE, log=True
--> sum: on_gpu=False, inputs_shape=(200, 100), indices=Yes, ivs=Yes, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 100), indices=No, ivs=No, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 100), indices=Yes, ivs=No, inference=MPE, log=True
--> sum: on_gpu=True, inputs_shape=(200, 100), indices=Yes, ivs=Yes, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 100), indices=No, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 100), indices=Yes, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 100), indices=Yes, ivs=Yes, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 100), indices=No, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 100), indices=Yes, ivs=No, inference=MPE, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 100), indices=Yes, ivs=Yes, inference=MPE, log=True
--> sum: on_gpu=False, inputs_shape=(200, 100), indices=No, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 100), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 100), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 100), indices=No, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 100), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> sum: on_gpu=True, inputs_shape=(200, 100), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 100), indices=No, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 100), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=False, inputs_shape=(200, 100), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 100), indices=No, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 100), indices=Yes, ivs=No, inference=MARGINAL, log=False
--> parallel_sums: on_gpu=True, inputs_shape=(200, 100), indices=Yes, ivs=Yes, inference=MARGINAL, log=False
--> sum: on_gpu=False, inputs_shape=(200, 100), indices=No, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 100), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=False, inputs_shape=(200, 100), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 100), indices=No, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 100), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> sum: on_gpu=True, inputs_shape=(200, 100), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 100), indices=No, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 100), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=False, inputs_shape=(200, 100), indices=Yes, ivs=Yes, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 100), indices=No, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 100), indices=Yes, ivs=No, inference=MARGINAL, log=True
--> parallel_sums: on_gpu=True, inputs_shape=(200, 100), indices=Yes, ivs=Yes, inference=MARGINAL, log=True

-----------------------
InferenceType: MARGINAL
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum 16219    No      No     9274.43          893.60          110.47           4.12       True
            sum 18219   Yes      No    10112.03          968.02           91.16           2.16       True
            sum 19340   Yes     Yes    10523.13         1118.07          102.64           4.94       True
  parallel_sums   339    No      No      180.47           19.88            2.03           0.41       True
  parallel_sums   359   Yes      No      195.45           20.21            2.22           0.56       True
  parallel_sums   620   Yes     Yes      339.10           31.84           89.18          84.84       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum 16219    No      No     8485.01          929.26          357.51           1.46       True
            sum 18219   Yes      No    10948.77         1071.21           81.45           1.74       True
            sum 19340   Yes     Yes    10671.98         1040.02          105.95           2.35       True
  parallel_sums   339    No      No      191.14           17.65            2.43           1.04       True
  parallel_sums   359   Yes      No      556.20           19.06            2.57           0.51       True
  parallel_sums   620   Yes     Yes      329.15           22.10            4.42           1.24       True

-----------------------
InferenceType: MARGINAL-LOG
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum 29359    No      No    15575.89         1590.36          203.92          23.16       True
            sum 31359   Yes      No    15954.16         1473.09          200.32          22.01       True
            sum 32490   Yes     Yes    17107.14         1552.84          223.71          23.19       True
  parallel_sums   659    No      No      939.94           23.62           31.13          41.21       True
  parallel_sums   679   Yes      No      350.21           34.55           28.89          39.39       True
  parallel_sums   910   Yes     Yes      477.47           45.28           67.90          91.25       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum 29359    No      No    14604.03         1344.53          144.14           9.09       True
            sum 31359   Yes      No    16734.98         1477.26          218.40           9.88       True
            sum 32490   Yes     Yes    16274.44         1326.41          209.14           9.25       True
  parallel_sums   659    No      No      345.78           33.40            5.64           1.28       True
  parallel_sums   679   Yes      No      433.24           32.18            5.66           1.31       True
  parallel_sums   910   Yes     Yes      459.48           42.39            6.75           1.79       True

-----------------------
InferenceType: MPE
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum 16219    No      No     8871.13          728.06           77.35          16.41       True
            sum 18219   Yes      No    10315.00          996.99          112.11          14.64       True
            sum 19340   Yes     Yes    10556.08          922.50          106.69          16.35       True
  parallel_sums   379    No      No      212.94           21.53           13.77          26.87       True
  parallel_sums   399   Yes      No      217.27           22.13           21.84          28.46       True
  parallel_sums   620   Yes     Yes      357.21           22.20           94.67          79.09       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum 16219    No      No     8267.20          853.78           86.29           2.90       True
            sum 18219   Yes      No    10144.91          817.05           86.14           2.93       True
            sum 19340   Yes     Yes    10548.87          995.65           81.83           2.69       True
  parallel_sums   379    No      No      274.29           21.78            2.97           1.09       True
  parallel_sums   399   Yes      No      181.74           14.24            2.41           0.65       True
  parallel_sums   620   Yes     Yes      700.08           20.33            4.36           1.25       True

-----------------------
InferenceType: MPE-LOG
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum 17239    No      No     9053.48          741.88           84.13           3.87       True
            sum 19239   Yes      No    10034.65          991.02           83.41           6.09       True
            sum 20370   Yes     Yes    10416.90          962.40          107.35           5.29       True
  parallel_sums   409    No      No      226.63           22.76           10.98          25.47       True
  parallel_sums   429   Yes      No      246.17           23.00           21.16          26.24       True
  parallel_sums   660   Yes     Yes      744.68           22.11           39.10          71.19       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum 17239    No      No     9272.75          969.60           85.36           3.42       True
            sum 19239   Yes      No    10833.23          902.40           92.29           3.10       True
            sum 20370   Yes     Yes    11661.89          874.15           78.09           3.39       True
  parallel_sums   409    No      No      221.45           32.16            4.00           1.48       True
  parallel_sums   429   Yes      No      208.70           23.90            4.62           1.50       True
  parallel_sums   660   Yes     Yes      373.02           34.10            6.50           1.69       True
