Params:
- num_input_rows=200
- num_input_vars=10
- num_input_vals=5
- num_decomps=4
- num_subsets=5
- num_mixtures=5
- num_input_mixtures=5
- balanced=True
- num_runs=50

Running tests:
--> dense: on_gpu=False, inputs_shape=(200, 10), input_dist=RAW, inference=MARGINAL, multi_nodes=False, log=False
--> dense: on_gpu=False, inputs_shape=(200, 10), input_dist=MIXTURE, inference=MARGINAL, multi_nodes=False, log=False
--> dense: on_gpu=True, inputs_shape=(200, 10), input_dist=RAW, inference=MARGINAL, multi_nodes=False, log=False
--> dense: on_gpu=True, inputs_shape=(200, 10), input_dist=MIXTURE, inference=MARGINAL, multi_nodes=False, log=False
--> dense_multinodes: on_gpu=False, inputs_shape=(200, 10), input_dist=RAW, inference=MARGINAL, multi_nodes=True, log=False
--> dense_multinodes: on_gpu=False, inputs_shape=(200, 10), input_dist=MIXTURE, inference=MARGINAL, multi_nodes=True, log=False
--> dense_multinodes: on_gpu=True, inputs_shape=(200, 10), input_dist=RAW, inference=MARGINAL, multi_nodes=True, log=False
--> dense_multinodes: on_gpu=True, inputs_shape=(200, 10), input_dist=MIXTURE, inference=MARGINAL, multi_nodes=True, log=False
--> dense: on_gpu=False, inputs_shape=(200, 10), input_dist=RAW, inference=MARGINAL, multi_nodes=False, log=True
--> dense: on_gpu=False, inputs_shape=(200, 10), input_dist=MIXTURE, inference=MARGINAL, multi_nodes=False, log=True
--> dense: on_gpu=True, inputs_shape=(200, 10), input_dist=RAW, inference=MARGINAL, multi_nodes=False, log=True
--> dense: on_gpu=True, inputs_shape=(200, 10), input_dist=MIXTURE, inference=MARGINAL, multi_nodes=False, log=True
--> dense_multinodes: on_gpu=False, inputs_shape=(200, 10), input_dist=RAW, inference=MARGINAL, multi_nodes=True, log=True
--> dense_multinodes: on_gpu=False, inputs_shape=(200, 10), input_dist=MIXTURE, inference=MARGINAL, multi_nodes=True, log=True
--> dense_multinodes: on_gpu=True, inputs_shape=(200, 10), input_dist=RAW, inference=MARGINAL, multi_nodes=True, log=True
--> dense_multinodes: on_gpu=True, inputs_shape=(200, 10), input_dist=MIXTURE, inference=MARGINAL, multi_nodes=True, log=True
--> dense: on_gpu=False, inputs_shape=(200, 10), input_dist=RAW, inference=MPE, multi_nodes=False, log=False
--> dense: on_gpu=False, inputs_shape=(200, 10), input_dist=MIXTURE, inference=MPE, multi_nodes=False, log=False
--> dense: on_gpu=True, inputs_shape=(200, 10), input_dist=RAW, inference=MPE, multi_nodes=False, log=False
--> dense: on_gpu=True, inputs_shape=(200, 10), input_dist=MIXTURE, inference=MPE, multi_nodes=False, log=False
--> dense_multinodes: on_gpu=False, inputs_shape=(200, 10), input_dist=RAW, inference=MPE, multi_nodes=True, log=False
--> dense_multinodes: on_gpu=False, inputs_shape=(200, 10), input_dist=MIXTURE, inference=MPE, multi_nodes=True, log=False
--> dense_multinodes: on_gpu=True, inputs_shape=(200, 10), input_dist=RAW, inference=MPE, multi_nodes=True, log=False
--> dense_multinodes: on_gpu=True, inputs_shape=(200, 10), input_dist=MIXTURE, inference=MPE, multi_nodes=True, log=False
--> dense: on_gpu=False, inputs_shape=(200, 10), input_dist=RAW, inference=MPE, multi_nodes=False, log=True
--> dense: on_gpu=False, inputs_shape=(200, 10), input_dist=MIXTURE, inference=MPE, multi_nodes=False, log=True
--> dense: on_gpu=True, inputs_shape=(200, 10), input_dist=RAW, inference=MPE, multi_nodes=False, log=True
--> dense: on_gpu=True, inputs_shape=(200, 10), input_dist=MIXTURE, inference=MPE, multi_nodes=False, log=True
--> dense_multinodes: on_gpu=False, inputs_shape=(200, 10), input_dist=RAW, inference=MPE, multi_nodes=True, log=True
--> dense_multinodes: on_gpu=False, inputs_shape=(200, 10), input_dist=MIXTURE, inference=MPE, multi_nodes=True, log=True
--> dense_multinodes: on_gpu=True, inputs_shape=(200, 10), input_dist=RAW, inference=MPE, multi_nodes=True, log=True
--> dense_multinodes: on_gpu=True, inputs_shape=(200, 10), input_dist=MIXTURE, inference=MPE, multi_nodes=True, log=True

-----------------------
InferenceType: MARGINAL
-----------------------
 CPU          op  SPN_size  TF_size  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
           dense   13203    56236        RAW    63228.70        16485.95         2449.34          56.73         True
           dense   13603    60636    MIXTURE    69764.18        19007.15         2396.34          57.67         True
dense_multinodes     107     1068        RAW      784.07          314.28           84.75          40.92         True
dense_multinodes     147     1788    MIXTURE     1280.10          513.10           66.39          41.41         True
 GPU          op  SPN_size  TF_size  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
           dense   13203    56236        RAW    64925.08        23810.75         4479.50         269.79         True
           dense   13603    60636    MIXTURE    69587.94        18240.26         3126.71         272.75         True
dense_multinodes     107     1068        RAW      768.89          290.32           47.67           4.63         True
dense_multinodes     147     1788    MIXTURE     1265.61          505.21           42.36           4.96         True

-----------------------
InferenceType: MARGINAL-LOG
-----------------------
 CPU          op  SPN_size  TF_size  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
           dense   13203    57550        RAW    69074.85        17172.16         2826.90          71.56         True
           dense   13603    64550    MIXTURE    72557.86        20342.42         2953.50          82.63         True
dense_multinodes     107     1442        RAW     1043.36          378.17           87.35          52.80         True
dense_multinodes     147     2882    MIXTURE     2051.93          722.74          118.13          57.74         True
 GPU          op  SPN_size  TF_size  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
           dense   13203    57550        RAW    65897.32        18180.44         3356.87         276.02         True
           dense   13603    64550    MIXTURE    72706.12        18760.48         3280.50         282.89         True
dense_multinodes     107     1442        RAW     1033.36          366.57           51.58           7.46         True
dense_multinodes     147     2882    MIXTURE     4034.07          844.50          105.03          11.78         True

-----------------------
InferenceType: MPE
-----------------------
 CPU          op  SPN_size  TF_size  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
           dense   13203    56236        RAW    64942.24        17116.34         2526.67          65.18         True
           dense   13603    60636    MIXTURE    69011.18        18803.58         2471.79          67.32         True
dense_multinodes     107     1148        RAW      895.83          337.17           72.32          51.99         True
dense_multinodes     147     2028    MIXTURE     1625.96          615.28           84.63          50.85         True
 GPU          op  SPN_size  TF_size  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
           dense   13203    56236        RAW    64606.82        17305.78         3081.38         270.77         True
           dense   13603    60636    MIXTURE    69114.59        19310.07         3320.26         275.86         True
dense_multinodes     107     1148        RAW      846.97          314.37           52.19           5.56         True
dense_multinodes     147     2028    MIXTURE     1452.41          581.14           51.61           6.29         True

-----------------------
InferenceType: MPE-LOG
-----------------------
 CPU          op  SPN_size  TF_size  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
           dense   13203    56338        RAW    65463.40        17495.69         2511.53          61.45         True
           dense   13603    60938    MIXTURE    68328.07        19211.09         2492.09          62.59         True
dense_multinodes     107     1170        RAW      863.04         2061.11           69.48          44.28         True
dense_multinodes     147     2090    MIXTURE     1630.37          552.77           77.96          45.99         True
 GPU          op  SPN_size  TF_size  input_dist  setup_time weights_init_time  first_run_time  rest_run_time    correct
           dense   13203    56338        RAW    66057.42        16473.20         3183.29         274.83         True
           dense   13603    60938    MIXTURE    69551.23        17904.79         3125.26         273.52         True
dense_multinodes     107     1170        RAW      999.07          302.49           32.98           5.66         True
dense_multinodes     147     2090    MIXTURE     1607.27          622.63           47.00           6.46         True
