Params:
- batch_size=500
- sum_sizes=[70, 80, 90, 100]
- num_runs=250
- num_parallel=10

Running tests:
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes

-----------------------
InferenceType: MARGINAL
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   741   Yes      No      402.83           38.27           24.13           1.42       True
       par_sums    85   Yes      No       76.76           10.85           10.21           1.27       True
     sums_layer    35   Yes      No       20.52            4.08            8.73           8.39       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   741   Yes      No      354.29           41.56           28.40           1.71       True
       par_sums    85   Yes      No       77.76           11.26           13.96           1.09       True
     sums_layer    35   Yes      No       18.20           17.04          160.29           0.70       True

-----------------------
InferenceType: MARGINAL
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  1301   Yes     Yes      604.69           50.43           79.04           8.60       True
       par_sums   165   Yes     Yes       65.39            8.11           29.59           9.44       True
     sums_layer    51   Yes     Yes       24.63            4.54           24.15          10.22       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  1301   Yes     Yes      497.59           51.58          150.89           4.63       True
       par_sums   165   Yes     Yes       64.15            8.38           11.32           1.09       True
     sums_layer    51   Yes     Yes       24.90            4.94            8.18           1.05       True

-----------------------
InferenceType: MARGINAL-LOG
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  1275   Yes      No      506.62           46.99          128.78           4.00       True
       par_sums   171   Yes      No       98.79            9.91           27.45           7.20       True
     sums_layer    63   Yes      No       30.59            4.63           17.25           8.38       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  1275   Yes      No      543.24           49.33           63.70           4.07       True
       par_sums   171   Yes      No       77.09            9.60           11.97           1.25       True
     sums_layer    63   Yes      No       33.79            4.71            9.68           0.93       True

-----------------------
InferenceType: MARGINAL-LOG
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  1875   Yes     Yes      820.60           65.34          208.15          12.24       True
       par_sums   239   Yes     Yes       94.58            9.51           30.66          11.97       True
     sums_layer    80   Yes     Yes       41.86            5.56           38.95          13.56       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  1875   Yes     Yes      763.02           62.06          126.04           8.81       True
       par_sums   239   Yes     Yes       93.76           10.09           18.02           1.39       True
     sums_layer    80   Yes     Yes       34.75            5.06            7.53           1.24       True

-----------------------
InferenceType: MPE
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   741   Yes      No      374.06           36.86           24.64           1.44       True
       par_sums   101   Yes      No       70.61            9.68           15.93           4.75       True
     sums_layer    35   Yes      No       17.03            3.91            7.06           9.20       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   741   Yes      No      301.28           36.91           23.79           1.01       True
       par_sums   101   Yes      No       62.68            9.69            7.46           0.99       True
     sums_layer    35   Yes      No       17.39            4.21            3.14           0.62       True

-----------------------
InferenceType: MPE
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  1301   Yes     Yes      560.36           50.20           79.40           9.12       True
       par_sums   165   Yes     Yes       65.31            8.12           35.12           9.43       True
     sums_layer    51   Yes     Yes       22.87            4.29           20.06          10.19       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  1301   Yes     Yes      488.12           49.85           75.34           4.83       True
       par_sums   165   Yes     Yes       65.09            8.31           11.33           1.04       True
     sums_layer    51   Yes     Yes       24.91            4.83            5.44           0.89       True

-----------------------
InferenceType: MPE-LOG
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   783   Yes      No      428.78           37.71           47.40           1.45       True
       par_sums   107   Yes      No       77.76            9.86           17.28           4.77       True
     sums_layer    38   Yes      No       20.35            4.40            7.53           4.92       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum   783   Yes      No      313.83           37.31           27.40           2.01       True
       par_sums   107   Yes      No       43.06            7.45            5.90           0.75       True
     sums_layer    38   Yes      No       17.73            4.21            3.43           0.58       True

-----------------------
InferenceType: MPE-LOG
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  1383   Yes     Yes      535.85           52.97          105.93           9.47       True
       par_sums   175   Yes     Yes       68.12            8.06           29.11           9.69       True
     sums_layer    55   Yes     Yes       32.22            5.12           26.65          10.64       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  1383   Yes     Yes      563.27           52.83          158.06           5.12       True
       par_sums   175   Yes     Yes       66.71            8.56           12.83           1.16       True
     sums_layer    55   Yes     Yes       24.32            4.61            5.46           0.93       True
