
ab1/effect.sse: A=old B=main
| prefill | arm | reps | TTFT ms | TPOT ms | tok/s | accept | tok/step | verify-step ms |
|---:|---|---:|---:|---:|---:|---:|---:|---:|
| 2048 | old | 3 | 357±2 | 7.55±0.19 | 132 | 0.416±0.012 | 3.92 | 29.56±0.10 |
| 2048 | main | 3 | 352±1 | 7.99±0.20 | 125 | 0.393±0.014 | 3.75 | 29.94±0.04 |
| 16384 | old | 3 | 2915±3 | 8.18±0.14 | 122 | 0.378±0.008 | 3.65 | 29.84±0.09 |
| 16384 | main | 3 | 2873±4 | 8.19±0.51 | 122 | 0.384±0.031 | 3.69 | 30.10±0.12 |
  raw 2048 old: r1 tpot=7.79 acc=0.402 step=29.70; r2 tpot=7.56 acc=0.415 step=29.52; r3 tpot=7.32 acc=0.432 step=29.47
  raw 2048 main: r1 tpot=8.07 acc=0.386 step=29.88; r2 tpot=8.19 acc=0.380 step=29.97; r3 tpot=7.71 acc=0.412 step=29.96
  raw 16384 old: r1 tpot=8.13 acc=0.381 step=29.78; r2 tpot=8.37 acc=0.368 step=29.97; r3 tpot=8.03 acc=0.386 step=29.77
  raw 16384 main: r1 tpot=8.79 acc=0.347 step=30.15; r2 tpot=7.55 acc=0.423 step=29.93; r3 tpot=8.24 acc=0.381 step=30.21

ab1/control.sse: A=main B=mainnull
| prefill | arm | reps | TTFT ms | TPOT ms | tok/s | accept | tok/step | verify-step ms |
|---:|---|---:|---:|---:|---:|---:|---:|---:|
| 2048 | main | 3 | 353±0 | 8.23±0.43 | 122 | 0.376±0.027 | 3.63 | 29.79±0.10 |
| 2048 | mainnull | 3 | 352±1 | 7.55±0.24 | 132 | 0.423±0.018 | 3.96 | 29.86±0.13 |
| 16384 | main | 3 | 2880±0 | 8.13±0.85 | 123 | 0.394±0.054 | 3.76 | 30.24±0.23 |
| 16384 | mainnull | 3 | 2880±5 | 8.38±0.86 | 119 | 0.377±0.049 | 3.64 | 30.20±0.18 |
  raw 2048 main: r1 tpot=7.77 acc=0.404 step=29.73; r2 tpot=8.80 acc=0.339 step=29.70; r3 tpot=8.11 acc=0.384 step=29.94
  raw 2048 mainnull: r1 tpot=7.87 acc=0.400 step=29.91; r2 tpot=7.31 acc=0.443 step=29.99; r3 tpot=7.47 acc=0.425 step=29.67
  raw 16384 main: r1 tpot=9.13 acc=0.335 step=30.57; r2 tpot=7.06 acc=0.465 step=30.09; r3 tpot=8.18 acc=0.382 step=30.06
  raw 16384 mainnull: r1 tpot=7.46 acc=0.432 step=30.03; r2 tpot=9.54 acc=0.313 step=30.45; r3 tpot=8.15 acc=0.385 step=30.13
