effect: off (67b5048d8b51) -> on (97fa8425f080)  errors=[]
| prefill | conc | TTFT ms A | TTFT ms B | dTTFT | verdict | prefill tok/s A | prefill tok/s B | dprefill | verdict | groupings A / B |
|---:|---:|---:|---:|---:|---|---:|---:|---:|---|---|
| 16384 | 1 | 194.8±0.3 | 196.6±0.8 | +0.92% | NOISE | 4123 [4107-4131] | 4086 [4046-4121] | -0.90% | NOISE | 1x1 1x1 1x1 / 1x1 1x1 1x1 |
| 65536 | 1 | 201.0±2.4 | 206.8±1.6 | +2.88% | NOISE | 2747 [2669-2833] | 2670 [2611-2710] | -2.83% | NOISE | 1x1 1x1 1x1 / 1x1 1x1 1x1 |

control: on (97fa8425f080) -> null (d23b3c07579c)  errors=[]
| prefill | conc | TTFT ms A | TTFT ms B | dTTFT | verdict | prefill tok/s A | prefill tok/s B | dprefill | verdict | groupings A / B |
|---:|---:|---:|---:|---:|---|---:|---:|---:|---|---|
| 16384 | 1 | 195.6±0.4 | 197.1±1.4 | +0.77% | NOISE | 4105 [4089-4128] | 4075 [3995-4127] | -0.74% | NOISE | 1x1 1x1 1x1 / 1x1 1x1 1x1 |
| 65536 | 1 | 200.9±0.7 | 209.9±5.2 | +4.49% | NOISE | 2748 [2721-2762] | 2637 [2460-2778] | -4.06% | NOISE | 1x1 1x1 1x1 / 1x1 1x1 1x1 |

Effect beside the null control; an effect inside the control is a null,
whatever the per-run verdict says (that verdict's spread is one boot's):
  prefill  16384 conc 1:  ttft_ms effect +0.92% control +0.77%  tpot_ms effect -0.55% control -2.03%  tps_prefill effect -0.90% control -0.74%
  prefill  65536 conc 1:  ttft_ms effect +2.88% control +4.49%  tpot_ms effect -3.45% control +1.22%  tps_prefill effect -2.83% control -4.06%
streams: /home/arbi-admin/roh/runs/turn_c1_oh/effect.sse /home/arbi-admin/roh/runs/turn_c1_oh/control.sse  (stack left up; 'scripts/bench/console_build_ab.sh down' tears it down)
