effect: off (daed8d0c75ee) -> on (9b12650ab4ca)  errors=[]
| prefill | conc | TTFT ms A | TTFT ms B | dTTFT | verdict | prefill tok/s A | prefill tok/s B | dprefill | verdict | groupings A / B |
|---:|---:|---:|---:|---:|---|---:|---:|---:|---|---|
| 16384 | 4 | 526.9±2.5 | 510.9±2.5 | -2.89% | NOISE | 4635 [3985-5006] | 4807 [4601-4939] | +4.20% | NOISE | 2x3,1x3,1x3,1x1 1x2,1x2,1x2,1x2 2x3,1x3,1x3,1x2 / 1x2,1x2,1x2,1x2 2x3,1x3,1x3,1x2 2x3,1x3,1x3,1x1 |
| 65536 | 4 | 545.3±0.4 | 545.9±0.1 | +0.12% | NOISE | 4436 [4416-4448] | 4457 [4421-4503] | -0.05% | NOISE | 1x2,1x2,1x2,1x2 1x2,1x2,1x2,1x2 1x2,1x2,1x2,1x2 / 1x2,1x2,1x2,1x2 1x2,1x2,1x2,1x2 2x3,1x3,1x3,1x2 |

control: on (9b12650ab4ca) -> null (8803fbf1c8e5)  errors=[]
| prefill | conc | TTFT ms A | TTFT ms B | dTTFT | verdict | prefill tok/s A | prefill tok/s B | dprefill | verdict | groupings A / B |
|---:|---:|---:|---:|---:|---|---:|---:|---:|---|---|
| 16384 | 4 | 504.1±0.7 | 505.7±0.5 | +0.28% | NOISE | 4917 [4842-5004] | 4920 [4874-4954] | +0.07% | NOISE | 1x2,1x2,1x2,1x2 2x3,1x3,1x3,1x2 1x2,1x2,1x2,1x2 / 1x2,1x2,1x2,1x2 1x2,1x2,1x2,1x2 2x3,1x3,1x3,1x2 |
| 65536 | 4 | 556.3±0.0 | 552.5±0.7 | -0.69% | NOISE | 4443 [4343-4502] | 4372 [4347-4418] | +0.66% | NOISE | 1x2,1x2,1x2,1x2 2x3,1x3,1x3,1x2 2x3,1x3,1x3,1x2 / 1x2,1x2,1x2,1x2 1x2,1x2,1x2,1x2 1x2,1x2,1x2,1x2 |

Effect beside the null control; an effect inside the control is a null,
whatever the per-run verdict says (that verdict's spread is one boot's):
  prefill  16384 conc 4:  ttft_ms effect -2.89% control +0.28%  tpot_ms effect -0.72% control -2.97%  tps_prefill effect +4.20% control +0.07%
  prefill  65536 conc 4:  ttft_ms effect +0.12% control -0.69%  tpot_ms effect -1.38% control -3.11%  tps_prefill effect -0.05% control +0.66%
streams: /home/arbi-admin/roh/runs/turn_c4_oh2/effect.sse /home/arbi-admin/roh/runs/turn_c4_oh2/control.sse  (stack left up; 'scripts/bench/console_build_ab.sh down' tears it down)
