Params:
- batch_size=500
- sum_sizes=[100]
- num_runs=250
- num_parallel=10

Running tests:
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes

-----------------------
InferenceType: MARGINAL
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   201   Yes      No      105.80           12.24            9.06           1.20       True
       par_sums    35   Yes      No       19.25            3.83            2.71           0.49       True
     sums_layer    35   Yes      No       24.68            4.71            5.45           2.54       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   201   Yes      No       97.61           12.56            8.82           0.89       True
       par_sums    35   Yes      No       27.15            5.43            4.04           0.73       True
     sums_layer    35   Yes      No       15.90            6.49          122.49           0.61       True

-----------------------
InferenceType: MARGINAL
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   341   Yes     Yes      142.08           14.92           21.16           3.00       True
       par_sums    55   Yes     Yes       43.46            6.19           13.55           4.31       True
     sums_layer    51   Yes     Yes       40.50            5.89           13.59           4.28       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   341   Yes     Yes      140.47           14.47           20.16           1.65       True
       par_sums    55   Yes     Yes       31.20            4.97            5.71           0.82       True
     sums_layer    51   Yes     Yes       37.55            5.92            7.07           1.06       True

-----------------------
InferenceType: MARGINAL-LOG
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   345   Yes      No      137.83           13.83           18.28           1.87       True
       par_sums    67   Yes      No       27.62            4.17            7.57           3.88       True
     sums_layer    63   Yes      No       47.73            6.20           11.57           2.58       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   345   Yes      No      137.34           14.45           18.06           1.31       True
       par_sums    67   Yes      No       72.44            4.38            7.91           0.64       True
     sums_layer    63   Yes      No       27.72            4.18            5.22           0.70       True

-----------------------
InferenceType: MARGINAL-LOG
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   495   Yes     Yes      193.92           16.91           34.26           4.15       True
       par_sums    84   Yes     Yes       40.37            4.87           16.99           5.12       True
     sums_layer    80   Yes     Yes       48.75            5.86           14.05           4.65       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   495   Yes     Yes      188.48           17.36           40.73           2.05       True
       par_sums    84   Yes     Yes       33.02            4.63            7.10           0.85       True
     sums_layer    80   Yes     Yes       33.89            4.85            7.43           0.76       True

-----------------------
InferenceType: MPE
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   201   Yes      No      214.79           13.61            8.37           1.26       True
       par_sums    39   Yes      No       24.86            4.25            5.85           2.27       True
     sums_layer    35   Yes      No       16.50            3.62            3.85           2.14       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   201   Yes      No       95.69           12.32            8.36           0.73       True
       par_sums    39   Yes      No       37.15            6.77            5.35           0.85       True
     sums_layer    35   Yes      No       16.18            3.76            3.02           0.49       True

-----------------------
InferenceType: MPE
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   341   Yes     Yes      136.63           14.77           20.38           3.25       True
       par_sums    55   Yes     Yes       22.96            4.08           14.96           3.94       True
     sums_layer    51   Yes     Yes       38.18            5.97           12.92           3.41       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   341   Yes     Yes      131.55           14.40           20.02           1.46       True
       par_sums    55   Yes     Yes       23.98            4.40            5.10           0.54       True
     sums_layer    51   Yes     Yes       28.30            4.84            5.46           0.88       True

-----------------------
InferenceType: MPE-LOG
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   213   Yes      No      106.86           12.48            9.27           1.33       True
       par_sums    42   Yes      No       45.45            7.08           10.49           3.00       True
     sums_layer    38   Yes      No       16.03            3.37            4.10           1.97       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   213   Yes      No      100.11           12.66            8.89           0.76       True
       par_sums    42   Yes      No       42.65            7.44            6.34           0.92       True
     sums_layer    38   Yes      No       16.82            3.76            3.09           0.43       True

-----------------------
InferenceType: MPE-LOG
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   363   Yes     Yes      144.69           14.98           23.52           3.33       True
       par_sums    59   Yes     Yes       39.12            5.78           13.60           4.06       True
     sums_layer    55   Yes     Yes       34.78            5.03           13.20           3.52       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   363   Yes     Yes      139.23           14.63           21.15           1.51       True
       par_sums    59   Yes     Yes       24.53            4.32            5.12           0.61       True
     sums_layer    55   Yes     Yes       35.36            5.52            6.60           0.96       True
