effect: off (daed8d0c75ee) -> on (9b12650ab4ca)  errors=[]
| prefill | conc | TTFT ms A | TTFT ms B | dTTFT | verdict | prefill tok/s A | prefill tok/s B | dprefill | verdict | groupings A / B |
|---:|---:|---:|---:|---:|---|---:|---:|---:|---|---|
| 16384 | 4 | 488.5±0.5 | 488.5±0.4 | -0.01% | NOISE | 5012 [4947-5109] | 4874 [4694-4980] | -0.02% | NOISE | 1x2,1x2,1x2,1x2 1x2,1x2,1x2,1x2 2x3,1x3,1x3,1x2 / 1x2,1x2,1x2,1x2 2x3,1x3,1x3,1x1 1x2,1x2,1x2,1x2 |
| 65536 | 4 | 542.2±0.6 | 540.1±0.3 | -0.37% | NOISE | 4416 [4312-4483] | 4480 [4470-4493] | +0.26% | NOISE | 1x2,1x2,1x2,1x2 2x3,1x3,1x3,1x1 1x2,1x2,1x2,1x2 / 1x2,1x2,1x2,1x2 1x2,1x2,1x2,1x2 1x2,1x2,1x2,1x2 |

control: on (9b12650ab4ca) -> null (8803fbf1c8e5)  errors=[]
| prefill | conc | TTFT ms A | TTFT ms B | dTTFT | verdict | prefill tok/s A | prefill tok/s B | dprefill | verdict | groupings A / B |
|---:|---:|---:|---:|---:|---|---:|---:|---:|---|---|
| 16384 | 4 | 486.5±0.0 | 498.1±0.0 | +2.37% | NOISE | 4795 [4693-4980] | 4993 [4896-5057] | -1.68% | NOISE | 2x3,1x3,1x3,1x1 2x3,1x3,1x3,1x1 1x2,1x2,1x2,1x2 / 1x2,1x2,1x2,1x2 2x3,1x3,1x3,1x2 2x3,1x3,1x3,1x2 |
| 65536 | 4 | 536.8±0.0 | 540.2±0.5 | +0.63% | LOSS | 4442 [4320-4505] | 4479 [4459-4492] | -0.53% | LOSS | 2x3,1x3,1x3,1x1 1x2,1x2,1x2,1x2 1x2,1x2,1x2,1x2 / 1x2,1x2,1x2,1x2 1x2,1x2,1x2,1x2 1x2,1x2,1x2,1x2 |

Effect beside the null control; an effect inside the control is a null,
whatever the per-run verdict says (that verdict's spread is one boot's):
  prefill  16384 conc 4:  ttft_ms effect -0.01% control +2.37%  tpot_ms effect +0.85% control +2.13%  tps_prefill effect -0.02% control -1.68%
  prefill  65536 conc 4:  ttft_ms effect -0.37% control +0.63%  tpot_ms effect +4.19% control +0.15%  tps_prefill effect +0.26% control -0.53%
streams: /home/arbi-admin/roh/runs/turn_c4_oh2/effect.sse /home/arbi-admin/roh/runs/turn_c4_oh2/control.sse  (stack left up; 'scripts/bench/console_build_ab.sh down' tears it down)
