Params:
- num_input_rows=200
- num_input_vars=40
- num_input_vals=5
- num_decomps=4
- num_subsets=5
- num_mixtures=5
- num_input_mixtures=5
- balanced=True
- num_runs=50

Running tests:
--> dense_block: on_gpu=False, inputs_shape=(200, 40), input_dist=RAW, inference=MARGINAL, node_type=BLOCK, log=False
--> dense_block: on_gpu=False, inputs_shape=(200, 40), input_dist=MIXTURE, inference=MARGINAL, node_type=BLOCK, log=False
--> dense_block: on_gpu=True, inputs_shape=(200, 40), input_dist=RAW, inference=MARGINAL, node_type=BLOCK, log=False
--> dense_block: on_gpu=True, inputs_shape=(200, 40), input_dist=MIXTURE, inference=MARGINAL, node_type=BLOCK, log=False
--> dense_layer: on_gpu=False, inputs_shape=(200, 40), input_dist=RAW, inference=MARGINAL, node_type=LAYER, log=False
--> dense_layer: on_gpu=False, inputs_shape=(200, 40), input_dist=MIXTURE, inference=MARGINAL, node_type=LAYER, log=False
--> dense_layer: on_gpu=True, inputs_shape=(200, 40), input_dist=RAW, inference=MARGINAL, node_type=LAYER, log=False
--> dense_layer: on_gpu=True, inputs_shape=(200, 40), input_dist=MIXTURE, inference=MARGINAL, node_type=LAYER, log=False
--> dense_block: on_gpu=False, inputs_shape=(200, 40), input_dist=RAW, inference=MARGINAL, node_type=BLOCK, log=True
--> dense_block: on_gpu=False, inputs_shape=(200, 40), input_dist=MIXTURE, inference=MARGINAL, node_type=BLOCK, log=True
--> dense_block: on_gpu=True, inputs_shape=(200, 40), input_dist=RAW, inference=MARGINAL, node_type=BLOCK, log=True
--> dense_block: on_gpu=True, inputs_shape=(200, 40), input_dist=MIXTURE, inference=MARGINAL, node_type=BLOCK, log=True
--> dense_layer: on_gpu=False, inputs_shape=(200, 40), input_dist=RAW, inference=MARGINAL, node_type=LAYER, log=True
--> dense_layer: on_gpu=False, inputs_shape=(200, 40), input_dist=MIXTURE, inference=MARGINAL, node_type=LAYER, log=True
--> dense_layer: on_gpu=True, inputs_shape=(200, 40), input_dist=RAW, inference=MARGINAL, node_type=LAYER, log=True
--> dense_layer: on_gpu=True, inputs_shape=(200, 40), input_dist=MIXTURE, inference=MARGINAL, node_type=LAYER, log=True
--> dense_block: on_gpu=False, inputs_shape=(200, 40), input_dist=RAW, inference=MPE, node_type=BLOCK, log=False
--> dense_block: on_gpu=False, inputs_shape=(200, 40), input_dist=MIXTURE, inference=MPE, node_type=BLOCK, log=False
--> dense_block: on_gpu=True, inputs_shape=(200, 40), input_dist=RAW, inference=MPE, node_type=BLOCK, log=False
--> dense_block: on_gpu=True, inputs_shape=(200, 40), input_dist=MIXTURE, inference=MPE, node_type=BLOCK, log=False
--> dense_layer: on_gpu=False, inputs_shape=(200, 40), input_dist=RAW, inference=MPE, node_type=LAYER, log=False
--> dense_layer: on_gpu=False, inputs_shape=(200, 40), input_dist=MIXTURE, inference=MPE, node_type=LAYER, log=False
--> dense_layer: on_gpu=True, inputs_shape=(200, 40), input_dist=RAW, inference=MPE, node_type=LAYER, log=False
--> dense_layer: on_gpu=True, inputs_shape=(200, 40), input_dist=MIXTURE, inference=MPE, node_type=LAYER, log=False
--> dense_block: on_gpu=False, inputs_shape=(200, 40), input_dist=RAW, inference=MPE, node_type=BLOCK, log=True
--> dense_block: on_gpu=False, inputs_shape=(200, 40), input_dist=MIXTURE, inference=MPE, node_type=BLOCK, log=True
--> dense_block: on_gpu=True, inputs_shape=(200, 40), input_dist=RAW, inference=MPE, node_type=BLOCK, log=True
--> dense_block: on_gpu=True, inputs_shape=(200, 40), input_dist=MIXTURE, inference=MPE, node_type=BLOCK, log=True
--> dense_layer: on_gpu=False, inputs_shape=(200, 40), input_dist=RAW, inference=MPE, node_type=LAYER, log=True
--> dense_layer: on_gpu=False, inputs_shape=(200, 40), input_dist=MIXTURE, inference=MPE, node_type=LAYER, log=True
--> dense_layer: on_gpu=True, inputs_shape=(200, 40), input_dist=RAW, inference=MPE, node_type=LAYER, log=True
--> dense_layer: on_gpu=True, inputs_shape=(200, 40), input_dist=MIXTURE, inference=MPE, node_type=LAYER, log=True

-----------------------
InferenceType: MARGINAL
-----------------------
 CPU          op  SPN_size  TF_size  mem_used  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
     dense_block     847    8628      0.0000        RAW     3971.93          637.80          547.31         178.15         True
     dense_block    2127   20148      0.0000    MIXTURE     9359.86         2099.62          718.87         180.08         True
     dense_layer      10     106      0.0000        RAW    18755.17           40.33         1174.31        1140.34         True
     dense_layer      12     133      0.0000    MIXTURE    17642.02           41.89         1173.12        1151.89         True
 GPU          op  SPN_size  TF_size  mem_used  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
     dense_block     847    8629   1008.0072        RAW     4360.36          988.25          560.64          49.80         True
     dense_block    2127   20149   1008.2844    MIXTURE     9107.64         2190.76          603.67          60.26         True
     dense_layer      10     107   1226.1174        RAW    17635.32           22.77          136.37          54.34         True
     dense_layer      12     134   1226.7031    MIXTURE    17542.62           28.33          129.65          54.73         True

-----------------------
InferenceType: MARGINAL-LOG
-----------------------
 CPU          op  SPN_size  TF_size  mem_used  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
     dense_block     847   13322      0.0000        RAW     5722.18          769.72         1555.86         872.45         True
     dense_block    2127   36362      0.0000    MIXTURE    15271.06         2534.00         2556.21         920.19         True
     dense_layer      10     148      0.0000        RAW    19497.60           36.12         1449.83        1291.08         True
     dense_layer      12     189      0.0000    MIXTURE    17411.08           41.52         1543.48        1325.16         True
 GPU          op  SPN_size  TF_size  mem_used  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
     dense_block     847   13323   1226.7031        RAW     6365.27          961.70          820.01          90.62         True
     dense_block    2127   36363   1226.7031    MIXTURE    15304.22         2661.59         1849.49         153.61         True
     dense_layer      10     149   1231.1782        RAW    17718.28           22.73          142.88          68.39         True
     dense_layer      12     190   1231.7640    MIXTURE    17756.24           29.22          147.91          69.81         True

-----------------------
InferenceType: MPE
-----------------------
 CPU          op  SPN_size  TF_size  mem_used  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
     dense_block     847    9668      0.0000        RAW     4509.40          672.61          996.39         564.63         True
     dense_block    2127   23748      0.0000    MIXTURE    10889.22         2158.06         1343.10         604.15         True
     dense_layer      10     106      0.0000        RAW    19145.13           36.08         1338.87        1145.64         True
     dense_layer      12     133      0.0000    MIXTURE    17709.68           41.25         1332.44        1170.20         True
 GPU          op  SPN_size  TF_size  mem_used  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
     dense_block     847    9669   1231.7640        RAW     5047.83          788.29          484.05          51.19         True
     dense_block    2127   23749   1231.7640    MIXTURE    10757.57         2277.21          923.87          63.78         True
     dense_layer      10     107   1231.7640        RAW    18258.35           22.12          129.89          54.39         True
     dense_layer      12     134   1231.7640    MIXTURE    17343.33           28.37          130.23          54.68         True

-----------------------
InferenceType: MPE-LOG
-----------------------
 CPU          op  SPN_size  TF_size  mem_used  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
     dense_block     847    9930      0.0000        RAW     4462.42          678.92          999.73         563.11         True
     dense_block    2127   24650      0.0000    MIXTURE    10782.66         2178.18         1515.99         600.30         True
     dense_layer      10     110      0.0000        RAW    19368.90           36.22         1088.98         970.53         True
     dense_layer      12     138      0.0000    MIXTURE    17636.98           42.05         1061.73        1001.06         True
 GPU          op  SPN_size  TF_size  mem_used  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
     dense_block     847    9931   1231.7640        RAW     5128.11          802.60          501.80          57.02         True
     dense_block    2127   24651   1231.7640    MIXTURE    11080.44         2258.80          803.29          73.91         True
     dense_layer      10     111   1231.7640        RAW    17556.67           22.25          129.22          54.40         True
     dense_layer      12     139   1231.7842    MIXTURE    17672.05           29.06          131.62          54.99         True
