Params:
- num_input_rows=200
- num_input_vars=5
- num_input_vals=5
- num_decomps=1
- num_subsets=5
- num_mixtures=5
- num_input_mixtures=5
- balanced=True
- num_runs=50

Running tests:
--> dense: on_gpu=False, inputs_shape=(200, 5), input_dist=RAW, inference=MARGINAL, multi_nodes=False, log=False
--> dense: on_gpu=False, inputs_shape=(200, 5), input_dist=MIXTURE, inference=MARGINAL, multi_nodes=False, log=False
--> dense: on_gpu=True, inputs_shape=(200, 5), input_dist=RAW, inference=MARGINAL, multi_nodes=False, log=False
--> dense: on_gpu=True, inputs_shape=(200, 5), input_dist=MIXTURE, inference=MARGINAL, multi_nodes=False, log=False
--> dense_multinodes: on_gpu=False, inputs_shape=(200, 5), input_dist=RAW, inference=MARGINAL, multi_nodes=True, log=False
--> dense_multinodes: on_gpu=False, inputs_shape=(200, 5), input_dist=MIXTURE, inference=MARGINAL, multi_nodes=True, log=False
--> dense_multinodes: on_gpu=True, inputs_shape=(200, 5), input_dist=RAW, inference=MARGINAL, multi_nodes=True, log=False
--> dense_multinodes: on_gpu=True, inputs_shape=(200, 5), input_dist=MIXTURE, inference=MARGINAL, multi_nodes=True, log=False
--> dense: on_gpu=False, inputs_shape=(200, 5), input_dist=RAW, inference=MARGINAL, multi_nodes=False, log=True
--> dense: on_gpu=False, inputs_shape=(200, 5), input_dist=MIXTURE, inference=MARGINAL, multi_nodes=False, log=True
--> dense: on_gpu=True, inputs_shape=(200, 5), input_dist=RAW, inference=MARGINAL, multi_nodes=False, log=True
--> dense: on_gpu=True, inputs_shape=(200, 5), input_dist=MIXTURE, inference=MARGINAL, multi_nodes=False, log=True
--> dense_multinodes: on_gpu=False, inputs_shape=(200, 5), input_dist=RAW, inference=MARGINAL, multi_nodes=True, log=True
--> dense_multinodes: on_gpu=False, inputs_shape=(200, 5), input_dist=MIXTURE, inference=MARGINAL, multi_nodes=True, log=True
--> dense_multinodes: on_gpu=True, inputs_shape=(200, 5), input_dist=RAW, inference=MARGINAL, multi_nodes=True, log=True
--> dense_multinodes: on_gpu=True, inputs_shape=(200, 5), input_dist=MIXTURE, inference=MARGINAL, multi_nodes=True, log=True
--> dense: on_gpu=False, inputs_shape=(200, 5), input_dist=RAW, inference=MPE, multi_nodes=False, log=False
--> dense: on_gpu=False, inputs_shape=(200, 5), input_dist=MIXTURE, inference=MPE, multi_nodes=False, log=False
--> dense: on_gpu=True, inputs_shape=(200, 5), input_dist=RAW, inference=MPE, multi_nodes=False, log=False
--> dense: on_gpu=True, inputs_shape=(200, 5), input_dist=MIXTURE, inference=MPE, multi_nodes=False, log=False
--> dense_multinodes: on_gpu=False, inputs_shape=(200, 5), input_dist=RAW, inference=MPE, multi_nodes=True, log=False
--> dense_multinodes: on_gpu=False, inputs_shape=(200, 5), input_dist=MIXTURE, inference=MPE, multi_nodes=True, log=False
--> dense_multinodes: on_gpu=True, inputs_shape=(200, 5), input_dist=RAW, inference=MPE, multi_nodes=True, log=False
--> dense_multinodes: on_gpu=True, inputs_shape=(200, 5), input_dist=MIXTURE, inference=MPE, multi_nodes=True, log=False
--> dense: on_gpu=False, inputs_shape=(200, 5), input_dist=RAW, inference=MPE, multi_nodes=False, log=True
--> dense: on_gpu=False, inputs_shape=(200, 5), input_dist=MIXTURE, inference=MPE, multi_nodes=False, log=True
--> dense: on_gpu=True, inputs_shape=(200, 5), input_dist=RAW, inference=MPE, multi_nodes=False, log=True
--> dense: on_gpu=True, inputs_shape=(200, 5), input_dist=MIXTURE, inference=MPE, multi_nodes=False, log=True
--> dense_multinodes: on_gpu=False, inputs_shape=(200, 5), input_dist=RAW, inference=MPE, multi_nodes=True, log=True
--> dense_multinodes: on_gpu=False, inputs_shape=(200, 5), input_dist=MIXTURE, inference=MPE, multi_nodes=True, log=True
--> dense_multinodes: on_gpu=True, inputs_shape=(200, 5), input_dist=RAW, inference=MPE, multi_nodes=True, log=True
--> dense_multinodes: on_gpu=True, inputs_shape=(200, 5), input_dist=MIXTURE, inference=MPE, multi_nodes=True, log=True

-----------------------
InferenceType: MARGINAL
-----------------------
 CPU          op  SPN_size  TF_size  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
           dense    3128    43786        RAW    16422.12         1393.96         2593.16          10.07         True
           dense    3178    13336    MIXTURE     7543.74          533.09         1109.99          10.01         True
dense_multinodes       9      102        RAW       55.30            8.80           28.81          26.11         True
dense_multinodes      14      192    MIXTURE      140.38           27.66           41.51          26.28         True
 GPU          op  SPN_size  TF_size  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
           dense    3128    43786        RAW    17143.98         1620.35         2955.08         114.59         True
           dense    3178    13336    MIXTURE     7447.58          544.84         1210.01          84.68         True
dense_multinodes       9      102        RAW       80.47           12.69           18.17           1.76         True
dense_multinodes      14      192    MIXTURE      147.57           28.45           16.68           1.82         True

-----------------------
InferenceType: MARGINAL-LOG
-----------------------
 CPU          op  SPN_size  TF_size  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
           dense    3128    43800        RAW    17164.31         1390.48         2581.66          11.41         True
           dense    3178    13675    MIXTURE     7581.42          591.96         1247.56          11.58         True
dense_multinodes       9      116        RAW       67.64           10.35           25.53          27.57         True
dense_multinodes      14      296    MIXTURE      603.61           20.00           46.84          31.34         True
 GPU          op  SPN_size  TF_size  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
           dense    3128    43800        RAW    17041.91         1409.90         2731.39          98.79         True
           dense    3178    13675    MIXTURE     7885.24          596.03         1628.41          97.81         True
dense_multinodes       9      116        RAW      101.08           11.12           16.89           1.83         True
dense_multinodes      14      296    MIXTURE      199.42           22.29           20.88           2.28         True

-----------------------
InferenceType: MPE
-----------------------
 CPU          op  SPN_size  TF_size  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
           dense    3128    43786        RAW    16765.38         1389.16         2549.13          10.89         True
           dense    3178    13336    MIXTURE     7662.84          541.63         1113.84          10.90         True
dense_multinodes       9      102        RAW       58.90            9.33           39.48          25.27         True
dense_multinodes      14      212    MIXTURE      130.56           26.05           45.64          29.81         True
 GPU          op  SPN_size  TF_size  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
           dense    3128    43786        RAW    17054.99         1397.52         2716.67          83.70         True
           dense    3178    13336    MIXTURE     7668.47          580.13         1347.07          90.84         True
dense_multinodes       9      102        RAW       74.41           11.77           17.34           1.61         True
dense_multinodes      14      212    MIXTURE      160.81           28.33           18.14           1.68         True

-----------------------
InferenceType: MPE-LOG
-----------------------
 CPU          op  SPN_size  TF_size  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
           dense    3128    43788        RAW    17260.23         1416.51         2577.66          10.34         True
           dense    3178    13363    MIXTURE     7631.21          586.11         1205.00          10.33         True
dense_multinodes       9      104        RAW       67.67           10.21           39.90          23.08         True
dense_multinodes      14      219    MIXTURE      163.91           25.89           43.14          29.21         True
 GPU          op  SPN_size  TF_size  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
           dense    3128    43788        RAW    16981.09         1441.19         2745.33         113.96         True
           dense    3178    13363    MIXTURE     7884.23          515.83         1229.79         111.83         True
dense_multinodes       9      104        RAW       95.39           13.91           20.47           1.79         True
dense_multinodes      14      219    MIXTURE      138.66           22.90           15.46           1.81         True
