Params:
- batch_size=500
- sum_sizes=[100, 100, 100, 100, 100, 100, 100, 100, 100, 100]
- num_runs=250
- num_parallel=10

Running tests:
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=No
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=False, IVs=Yes
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=No
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MARGINAL, log=True, IVs=Yes
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=No
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=False, IVs=Yes
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=No
--> sums_layer: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes
--> sums_layer: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes
--> par_sums: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes
--> par_sums: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes
--> sum: on_gpu=True, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes
--> sum: on_gpu=False, inputs_shape=(500, 100), indices=Yes, inference=MPE, log=True, IVs=Yes

-----------------------
InferenceType: MARGINAL
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  1821   Yes      No      931.69           92.28           61.27           1.88       True
       par_sums   181   Yes      No      103.00           12.68            8.67           1.39       True
     sums_layer    35   Yes      No       24.80            4.84           25.54          16.11       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  1821   Yes      No      862.27           92.28           66.74           3.08       True
       par_sums   181   Yes      No       84.88           12.84            8.63           1.49       True
     sums_layer    35   Yes      No       18.90           12.41          198.87           1.01       True

-----------------------
InferenceType: MARGINAL
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  3221   Yes     Yes     1328.69          129.32          222.44          23.29       True
       par_sums   381   Yes     Yes      149.94           16.12           52.05          25.40       True
     sums_layer    51   Yes     Yes       29.04            5.12           41.16          23.52       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  3221   Yes     Yes     1275.21          127.81          213.87           9.90       True
       par_sums   381   Yes     Yes      144.23           16.25           23.86           1.80       True
     sums_layer    51   Yes     Yes       26.40            5.11            6.24           1.54       True

-----------------------
InferenceType: MARGINAL-LOG
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  3135   Yes      No     1459.94          120.02          171.83           9.48       True
       par_sums   375   Yes      No      194.05           17.29           48.29          18.00       True
     sums_layer    63   Yes      No       33.83            5.32           49.32          19.40       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  3135   Yes      No     1288.33          120.20          170.98          11.39       True
       par_sums   375   Yes      No      147.21           16.83           22.32           1.61       True
     sums_layer    63   Yes      No       30.48            5.15            6.22           1.19       True

-----------------------
InferenceType: MARGINAL-LOG
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  4635   Yes     Yes     1847.84          162.92          364.92          32.51       True
       par_sums   545   Yes     Yes      234.40           20.78           84.65          32.68       True
     sums_layer    80   Yes     Yes       36.03            5.28           74.61          31.86       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  4635   Yes     Yes     1829.77          156.34          351.21          22.35       True
       par_sums   545   Yes     Yes      204.37           19.89           85.14           3.84       True
     sums_layer    80   Yes     Yes       34.62            5.54            8.58           2.07       True

-----------------------
InferenceType: MPE
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  1821   Yes      No      892.69           91.93           67.79           2.78       True
       par_sums   221   Yes      No      128.39           15.55           36.98          11.36       True
     sums_layer    35   Yes      No       18.74            4.40           13.84          20.11       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  1821   Yes      No      844.56           90.24           65.73           2.93       True
       par_sums   221   Yes      No      135.70           16.68           12.36           1.36       True
     sums_layer    35   Yes      No       19.13            4.85            3.46           0.86       True

-----------------------
InferenceType: MPE
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  3221   Yes     Yes     1341.50          129.68          229.56          24.84       True
       par_sums   381   Yes     Yes      161.15           16.99           68.00          25.42       True
     sums_layer    51   Yes     Yes       27.38            5.00           46.80          23.63       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  3221   Yes     Yes     1309.11          124.56          213.93          12.15       True
       par_sums   381   Yes     Yes      146.60           16.31           23.67           1.93       True
     sums_layer    51   Yes     Yes       27.72            5.31            6.14           1.52       True

-----------------------
InferenceType: MPE-LOG
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  1923   Yes      No      876.36           93.32           75.63           2.78       True
       par_sums   233   Yes      No      107.56           15.00           32.06          11.62       True
     sums_layer    38   Yes      No       29.14            5.78           22.74          20.40       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  1923   Yes      No      850.85           92.09           70.87           4.00       True
       par_sums   233   Yes      No      112.99           15.89           12.91           1.11       True
     sums_layer    38   Yes      No       19.87            4.72            3.82           0.77       True

-----------------------
InferenceType: MPE-LOG
-----------------------
CPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  3423   Yes     Yes     1408.23          132.96          242.18          26.41       True
       par_sums   403   Yes     Yes      215.80           16.99           70.02          26.11       True
     sums_layer    55   Yes     Yes       28.87            5.08           45.49          24.81       True
GPU          op  size indices   ivs  setup_time weights_init_time  first_run_time  rest_run_time    correct
            sum  3423   Yes     Yes     1319.52          192.02          289.16          13.16       True
       par_sums   403   Yes     Yes      152.26           16.38           25.24           2.16       True
     sums_layer    55   Yes     Yes       26.14            4.99            6.12           1.58       True
