02:26:25 WARNING DIAGSTEP t=1790648785.148 total=11784.8ms drain_done=0.0 seed_slate_built=0.8 seed_drains_done=0.7 seed_batch_built=0.8 dseed_fwd_launched=310.3 dseed_sampled=0.0 dseed_observed=129.0 seed_launch_done=1.3 seed_device_drained=1.7 seed_forward_joined=0.1 seed_commit_done=0.1 drain_begin=1.6 drain_done=0.0 seed_slate_built=0.7 seed_drains_done=0.0 seed_batch_built=0.7 dseed_fwd_launched=312.8 dseed_sampled=8.1 dseed_observed=1.8 seed_launch_done=18.5 seed_device_drained=0.2 seed_forward_joined=0.1 seed_commit_done=0.2 drain_begin=1.7 drain_done=0.0 fused_halves_built=1.4 fused_batch_built=1.4 fused_forward_done=166.0 dseed_sampled=4.1 dseed_observed=4.9 fused_prefill_committed=2.1 verify_accept_enqueued=20.5 verify_drafts_host=2.9 verify_rollback_done=13.3 verify_parked=0.1 fused_verify_done=0.0 drain_begin=0.7 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=1.0 verify_forward_done=1.9 verify_accept_enqueued=32.7 verify_drafts_host=2.8 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.6 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.5 verify_forward_done=0.5 verify_accept_enqueued=33.1 verify_drafts_host=2.4 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.4 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.3 verify_forward_done=0.4 verify_accept_enqueued=34.5 verify_drafts_host=2.6 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.5 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.3 verify_forward_done=0.3 verify_accept_enqueued=33.9 verify_drafts_host=2.2 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.4 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.3 verify_forward_done=0.3 verify_accept_enqueued=34.2 verify_drafts_host=2.1 verify_rollback_done=0.2 verify_parked=0.1 drain_begin=0.4 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.3 verify_forward_done=0.3 verify_accept_enqueued=34.5 verify_drafts_host=2.2 verify_rollback_done=0.2 verify_parked=0.1 drain_begin=0.4 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.3 verify_forward_done=0.3 verify_accept_enqueued=34.5 verify_drafts_host=2.5 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.4 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.3 verify_forward_done=0.3 verify_accept_enqueued=34.3 verify_drafts_host=2.4 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.5 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.3 verify_forward_done=0.3 verify_accept_enqueued=34.2 verify_drafts_host=2.2 verify_rollback_done=0.2 verify_parked=0.1 drain_begin=0.5 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.4 verify_forward_done=0.5 verify_accept_enqueued=34.1 verify_drafts_host=2.4 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.4 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.3 verify_forward_done=0.3 verify_accept_enqueued=34.4 verify_drafts_host=2.2 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.5 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.4 verify_forward_done=0.4 verify_accept_enqueued=34.0 verify_drafts_host=2.3 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.5 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.4 verify_forward_done=0.4 verify_accept_enqueued=33.9 verify_drafts_host=2.2 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.5 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.3 verify_forward_done=0.4 verify_accept_enqueued=34.1 verify_drafts_host=2.2 verify_rollback_done=0.2 verify_parked=0.1 drain_begin=0.4 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.3 verify_forward_done=0.3 verify_accept_enqueued=34.3 verify_drafts_host=2.1 verify_rollback_done=0.2 verify_parked=0.1 verify_flush_done=0.1 verify_drain_synced=0.0 drain_begin=2100.5 drain_done=0.0 seed_slate_built=0.8 seed_drains_done=0.6 seed_batch_built=0.8 dseed_fwd_launched=309.4 dseed_sampled=0.0 dseed_observed=1.4 seed_launch_done=0.0 seed_device_drained=12.9 seed_forward_joined=0.1 seed_commit_done=0.0 drain_begin=1.3 drain_done=0.0 seed_slate_built=0.5 seed_drains_done=0.0 seed_batch_built=0.5 dseed_fwd_launched=313.2 dseed_sampled=7.9 dseed_observed=1.4 seed_launch_done=1.1 seed_device_drained=7.6 seed_forward_joined=0.1 seed_commit_done=0.1 drain_begin=1.8 drain_done=0.0 fused_halves_built=1.2 fused_batch_built=1.2 fused_forward_done=166.6 dseed_sampled=4.2 dseed_observed=3.6 fused_prefill_committed=2.1 verify_accept_enqueued=0.7 verify_drafts_host=2.0 verify_rollback_done=0.3 verify_parked=0.1 fused_verify_done=0.0 drain_begin=0.7 verify_flush_done=0.0 verify_drain_synced=2.2 drain_done=0.1 verify_plan_built=0.6 verify_forward_done=0.5 verify_accept_enqueued=34.1 verify_drafts_host=2.3 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.5 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.3 verify_forward_done=0.4 verify_accept_enqueued=34.2 verify_drafts_host=2.6 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.5 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.3 verify_forward_done=0.4 verify_accept_enqueued=33.9 verify_drafts_host=2.3 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.5 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.3 verify_forward_done=0.4 verify_accept_enqueued=34.0 verify_drafts_host=2.5 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.5 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.3 verify_forward_done=0.3 verify_accept_enqueued=34.2 verify_drafts_host=2.6 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.5 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.2 verify_plan_built=0.4 verify_forward_done=0.3 verify_accept_enqueued=33.7 verify_drafts_host=2.2 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.5 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.6 verify_forward_done=0.3 verify_accept_enqueued=33.7 verify_drafts_host=3.3 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.6 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.3 verify_forward_done=0.4 verify_accept_enqueued=33.3 verify_drafts_host=2.3 verify_rollback_done=0.3 verify_parked=0.1 drain_begin=0.5 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.3 verify_forward_done=0.3 verify_accept_enqueued=33.9 verify_drafts_host=2.2 verify_rollback_done=0.2 verify_parked=0.1 drain_begin=0.5 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.1 verify_plan_built=0.4 verify_forward_done=0.4 verify_accept_enqueued=33.9 verify_drafts_host=2.1 verify_rollback_done=0.2 verify_parked=0.1 drain_begin=0.5 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.2 verify_plan_built=0.5 verify_forward_done=0.4 verify_accept_enqueued=33.8 verify_drafts_host=2.1 verify_rollback_done=0.2 verify_parked=0.1 drain_begin=0.5 verify_flush_done=0.0 verify_drain_synced=0.0 drain_done=0.2 verify_plan_built=0.4 verify_forward_done=0.3 verify_accept_enqueued=34.1 verify_drafts_host=2.0 verify_rollback_done=0.2 verify_parked=0.1 verify_flush_done=0.1 verify_drain_synced=0.0 step_begin=6799.8
02:26:31 WARNING DIAGSTEP t=1790648791.889 total=556.1ms sched_done=0.3 drain_begin=0.1 drain_done=0.0 seed_slate_built=0.5 seed_drains_done=0.0 seed_batch_built=3.0 dseed_fwd_launched=377.0 dseed_sampled=0.0 dseed_observed=10.6 seed_launch_done=0.0 seed_device_drained=162.8 seed_forward_joined=0.1 seed_commit_done=0.1 step_end=0.0 step_begin=1.6
02:26:31 INFO    ✓ done#1 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.643s total=5.650s gen=N/A kv=552.5MiB status=length
02:26:31 WARNING DIAGSTEP t=1790648791.998 total=109.3ms sched_done=0.9 drain_begin=0.1 drain_done=0.0 seed_slate_built=0.4 seed_drains_done=0.0 seed_batch_built=0.7 dseed_fwd_launched=72.5 dseed_sampled=16.9 dseed_observed=1.9 seed_launch_done=1.1 seed_device_drained=2.8 seed_forward_joined=0.1 seed_commit_done=8.8 step_end=0.2 step_begin=3.1
02:26:32 INFO    {'request_id': 'a6bd9c4811e24463ab19391bf375aaf6'} savepoint crossing writes armed for tenant '_global': a request's radix walk reached 32768 tokens of a stored prefix but the deepest savepoint it could resume from covers 0, so a crossing write at the governor line between them (every 2048 tokens) would have served it. This tenant's prefills write crossings from now on; partial_match_lost_total counts the requests this one and any later ones cost.
02:26:37 WARNING DIAGSTEP t=1790648797.554 total=551.6ms sched_done=0.4 drain_begin=0.1 drain_done=0.0 seed_slate_built=1.5 seed_drains_done=0.0 seed_batch_built=1.6 dseed_fwd_launched=375.9 dseed_sampled=0.0 dseed_observed=14.0 seed_launch_done=0.0 seed_device_drained=157.2 seed_forward_joined=0.1 seed_commit_done=0.6 step_end=0.0 step_begin=0.3
02:26:37 WARNING DIAGSTEP t=1790648797.657 total=103.6ms sched_done=0.8 drain_begin=0.2 drain_done=0.0 seed_slate_built=0.8 seed_drains_done=0.0 seed_batch_built=1.5 dseed_fwd_launched=79.1 dseed_sampled=14.8 dseed_observed=1.5 seed_launch_done=1.1 seed_device_drained=2.9 seed_forward_joined=0.1 seed_commit_done=0.5 step_end=0.4 step_begin=0.1
02:26:43 INFO    ✓ done#2 prompt=33133 cached=0(0%) out=849(reason=671 content=178) ttft=5.653s total=11.771s gen=138.8tok/s kv=565.2MiB status=stop
02:26:43 INFO    {'request_id': '027c576fc0014b659384cd86d7b6051b'} savepoint resume: req=3 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
02:26:43 WARNING DIAGSTEP t=1790648803.898 total=113.4ms sched_done=0.3 drain_begin=0.1 drain_done=0.0 seed_slate_built=0.4 seed_drains_done=15.1 seed_batch_built=0.9 dseed_fwd_launched=73.7 dseed_sampled=15.8 dseed_observed=1.4 seed_launch_done=1.1 seed_device_drained=2.7 seed_forward_joined=0.1 seed_commit_done=1.4 step_end=0.4 step_begin=0.1
02:26:58 INFO    ✓ done#3 prompt=33150 cached=32768(99%) out=1903(reason=1760 content=143) ttft=0.115s total=14.742s gen=130.1tok/s kv=582.2MiB status=stop
02:27:04 WARNING DIAGSTEP t=1790648824.101 total=555.9ms sched_done=0.5 drain_begin=0.1 drain_done=0.0 seed_slate_built=2.1 seed_drains_done=0.0 seed_batch_built=1.6 dseed_fwd_launched=377.8 dseed_sampled=0.0 dseed_observed=14.0 seed_launch_done=0.0 seed_device_drained=158.4 seed_forward_joined=0.1 seed_commit_done=0.7 step_end=0.2 step_begin=0.4
02:27:04 INFO    ✓ done#4 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.674s total=5.676s gen=N/A kv=552.5MiB status=length
02:27:04 WARNING DIAGSTEP t=1790648824.208 total=107.4ms sched_done=1.0 drain_begin=0.2 drain_done=0.0 seed_slate_built=0.8 seed_drains_done=0.0 seed_batch_built=1.4 dseed_fwd_launched=77.1 dseed_sampled=16.7 dseed_observed=1.5 seed_launch_done=1.1 seed_device_drained=2.9 seed_forward_joined=0.1 seed_commit_done=3.4 step_end=1.0 step_begin=0.2
02:27:04 INFO    {'request_id': '45ac80ed02224540a2feb83815c7261f'} savepoint resume: req=5 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
02:27:04 WARNING DIAGSTEP t=1790648824.331 total=113.6ms sched_done=0.3 drain_begin=0.2 drain_done=0.0 seed_slate_built=0.5 seed_drains_done=15.2 seed_batch_built=1.0 dseed_fwd_launched=76.3 dseed_sampled=12.8 dseed_observed=1.8 seed_launch_done=1.2 seed_device_drained=2.5 seed_forward_joined=0.1 seed_commit_done=1.2 step_end=0.4 step_begin=0.1
02:27:10 INFO    ✓ done#5 prompt=33133 cached=32768(99%) out=998(reason=876 content=122) ttft=0.116s total=6.102s gen=166.7tok/s kv=569.5MiB status=stop
02:27:10 INFO    {'request_id': '77547375a79f4cc6a8dbcc29959bebbe'} savepoint resume: req=6 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
02:27:10 WARNING DIAGSTEP t=1790648830.438 total=115.4ms sched_done=0.3 drain_begin=0.2 drain_done=0.0 seed_slate_built=0.4 seed_drains_done=16.4 seed_batch_built=1.0 dseed_fwd_launched=74.6 dseed_sampled=15.7 dseed_observed=1.4 seed_launch_done=1.0 seed_device_drained=2.7 seed_forward_joined=0.1 seed_commit_done=1.2 step_end=0.0 step_begin=0.5
02:27:20 INFO    ✓ done#6 prompt=33150 cached=32768(99%) out=1259(reason=1145 content=114) ttft=0.116s total=9.776s gen=130.3tok/s kv=573.8MiB status=stop
02:27:25 WARNING DIAGSTEP t=1790648845.683 total=556.6ms sched_done=0.5 drain_begin=0.1 drain_done=0.0 seed_slate_built=2.2 seed_drains_done=0.0 seed_batch_built=1.6 dseed_fwd_launched=378.3 dseed_sampled=0.0 dseed_observed=14.0 seed_launch_done=0.0 seed_device_drained=158.7 seed_forward_joined=0.1 seed_commit_done=0.6 step_end=0.2 step_begin=0.2
02:27:25 INFO    ✓ done#7 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.687s total=5.690s gen=N/A kv=552.5MiB status=length
02:27:25 WARNING DIAGSTEP t=1790648845.794 total=111.3ms sched_done=0.9 drain_begin=0.2 drain_done=0.0 seed_slate_built=0.9 seed_drains_done=0.0 seed_batch_built=1.9 dseed_fwd_launched=77.1 dseed_sampled=19.9 dseed_observed=1.4 seed_launch_done=1.1 seed_device_drained=2.9 seed_forward_joined=0.1 seed_commit_done=3.7 step_end=1.0 step_begin=0.2
02:27:25 INFO    {'request_id': 'd7a0ed4fd4a84d0c8730b667e2e54707'} savepoint resume: req=8 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
02:27:25 WARNING DIAGSTEP t=1790648845.916 total=114.4ms sched_done=0.4 drain_begin=0.6 drain_done=0.0 seed_slate_built=0.5 seed_drains_done=15.3 seed_batch_built=0.9 dseed_fwd_launched=73.6 dseed_sampled=16.2 dseed_observed=1.5 seed_launch_done=1.1 seed_device_drained=2.6 seed_forward_joined=0.1 seed_commit_done=1.1 step_end=0.3 step_begin=0.1
02:27:36 INFO    ✓ done#8 prompt=33133 cached=32768(99%) out=1754(reason=1630 content=124) ttft=0.116s total=10.308s gen=172.1tok/s kv=582.2MiB status=stop
02:27:36 INFO    {'request_id': 'b66a72615f6c44a88110af2b08d0f835'} savepoint resume: req=9 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
02:27:36 WARNING DIAGSTEP t=1790648856.227 total=114.4ms sched_done=0.3 drain_begin=0.2 drain_done=0.0 seed_slate_built=0.3 seed_drains_done=15.1 seed_batch_built=0.9 dseed_fwd_launched=74.8 dseed_sampled=16.3 dseed_observed=1.4 seed_launch_done=1.1 seed_device_drained=2.7 seed_forward_joined=0.1 seed_commit_done=1.1 step_end=0.0 step_begin=0.1
02:27:42 INFO    ✓ done#9 prompt=33150 cached=32768(99%) out=987(reason=814 content=173) ttft=0.115s total=6.046s gen=166.4tok/s kv=569.5MiB status=stop
02:27:47 WARNING DIAGSTEP t=1790648867.749 total=555.7ms sched_done=0.5 drain_begin=0.1 drain_done=0.0 seed_slate_built=2.2 seed_drains_done=0.0 seed_batch_built=1.6 dseed_fwd_launched=377.7 dseed_sampled=0.0 dseed_observed=14.0 seed_launch_done=0.0 seed_device_drained=158.9 seed_forward_joined=0.1 seed_commit_done=0.6 step_end=0.0 step_begin=0.1
02:27:47 INFO    ✓ done#10 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.689s total=5.692s gen=N/A kv=552.5MiB status=length
02:27:47 WARNING DIAGSTEP t=1790648867.856 total=107.3ms sched_done=0.5 drain_begin=0.3 drain_done=0.0 seed_slate_built=0.6 seed_drains_done=0.0 seed_batch_built=1.2 dseed_fwd_launched=77.6 dseed_sampled=16.8 dseed_observed=1.5 seed_launch_done=1.1 seed_device_drained=2.9 seed_forward_joined=0.1 seed_commit_done=3.4 step_end=0.8 step_begin=0.3
02:27:47 INFO    {'request_id': '59af4ed9a0c34805a34a6527dbcc8859'} savepoint resume: req=11 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
02:27:47 WARNING DIAGSTEP t=1790648867.978 total=113.5ms sched_done=0.4 drain_begin=0.5 drain_done=0.0 seed_slate_built=0.6 seed_drains_done=15.4 seed_batch_built=1.0 dseed_fwd_launched=73.8 dseed_sampled=15.0 dseed_observed=1.4 seed_launch_done=1.1 seed_device_drained=2.7 seed_forward_joined=0.1 seed_commit_done=1.2 step_end=0.1 step_begin=0.2
02:27:57 INFO    ✓ done#11 prompt=33133 cached=32768(99%) out=1437(reason=1281 content=156) ttft=0.116s total=9.402s gen=154.7tok/s kv=578.0MiB status=stop
02:27:57 INFO    {'request_id': 'c067d8750bd445859dd642a57400f10d'} savepoint resume: req=12 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
02:27:57 WARNING DIAGSTEP t=1790648877.383 total=114.1ms sched_done=0.3 drain_begin=0.2 drain_done=0.0 seed_slate_built=0.4 seed_drains_done=15.6 seed_batch_built=0.9 dseed_fwd_launched=74.1 dseed_sampled=15.8 dseed_observed=1.4 seed_launch_done=1.1 seed_device_drained=2.7 seed_forward_joined=0.1 seed_commit_done=1.2 step_end=0.3 step_begin=0.1
02:28:03 INFO    ✓ done#12 prompt=33150 cached=32768(99%) out=1023(reason=844 content=179) ttft=0.115s total=6.536s gen=159.3tok/s kv=569.5MiB status=stop
02:28:09 WARNING DIAGSTEP t=1790648889.396 total=556.3ms sched_done=0.4 drain_begin=0.1 drain_done=0.0 seed_slate_built=2.2 seed_drains_done=0.0 seed_batch_built=1.6 dseed_fwd_launched=378.0 dseed_sampled=0.0 dseed_observed=14.0 seed_launch_done=0.0 seed_device_drained=158.8 seed_forward_joined=0.1 seed_commit_done=0.6 step_end=0.2 step_begin=0.1
02:28:09 INFO    ✓ done#13 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.689s total=5.692s gen=N/A kv=552.5MiB status=length
02:28:09 WARNING DIAGSTEP t=1790648889.502 total=106.9ms sched_done=0.9 drain_begin=0.2 drain_done=0.0 seed_slate_built=0.9 seed_drains_done=0.0 seed_batch_built=1.5 dseed_fwd_launched=78.5 dseed_sampled=14.8 dseed_observed=1.5 seed_launch_done=1.1 seed_device_drained=2.9 seed_forward_joined=0.1 seed_commit_done=3.5 step_end=0.2 step_begin=0.8
02:28:09 INFO    {'request_id': 'a068774efcc14e878128752212aed5b6'} savepoint resume: req=14 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
02:28:09 WARNING DIAGSTEP t=1790648889.625 total=114.2ms sched_done=0.5 drain_begin=0.5 drain_done=0.0 seed_slate_built=0.5 seed_drains_done=15.1 seed_batch_built=0.9 dseed_fwd_launched=74.0 dseed_sampled=15.8 dseed_observed=1.4 seed_launch_done=1.1 seed_device_drained=2.7 seed_forward_joined=0.1 seed_commit_done=1.1 step_end=0.1 step_begin=0.3
02:28:20 INFO    ✓ done#14 prompt=33133 cached=32768(99%) out=1517(reason=1377 content=140) ttft=0.116s total=10.659s gen=143.9tok/s kv=578.0MiB status=stop
02:28:20 INFO    {'request_id': 'c853594aa81c442798c45634328284fd'} savepoint resume: req=15 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
02:28:20 WARNING DIAGSTEP t=1790648900.285 total=113.5ms sched_done=0.3 drain_begin=0.1 drain_done=0.0 seed_slate_built=0.4 seed_drains_done=15.0 seed_batch_built=0.9 dseed_fwd_launched=73.9 dseed_sampled=16.1 dseed_observed=1.4 seed_launch_done=1.1 seed_device_drained=2.7 seed_forward_joined=0.1 seed_commit_done=1.1 step_end=0.3 step_begin=0.1
02:28:26 INFO    ✓ done#15 prompt=33150 cached=32768(99%) out=862(reason=669 content=193) ttft=0.114s total=6.331s gen=138.7tok/s kv=565.2MiB status=stop
02:28:32 WARNING DIAGSTEP t=1790648912.095 total=555.8ms sched_done=0.5 drain_begin=0.1 drain_done=0.0 seed_slate_built=2.1 seed_drains_done=0.0 seed_batch_built=1.6 dseed_fwd_launched=377.9 dseed_sampled=0.0 dseed_observed=14.0 seed_launch_done=0.0 seed_device_drained=158.5 seed_forward_joined=0.1 seed_commit_done=0.6 step_end=0.2 step_begin=0.1
02:28:32 INFO    ✓ done#16 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.692s total=5.695s gen=N/A kv=552.5MiB status=length
02:28:32 WARNING DIAGSTEP t=1790648912.203 total=108.2ms sched_done=0.8 drain_begin=0.1 drain_done=0.0 seed_slate_built=0.7 seed_drains_done=0.0 seed_batch_built=1.3 dseed_fwd_launched=77.4 dseed_sampled=17.6 dseed_observed=1.4 seed_launch_done=1.1 seed_device_drained=2.9 seed_forward_joined=0.1 seed_commit_done=3.7 step_end=0.9 step_begin=0.2
02:28:32 INFO    {'request_id': '28bf6a8c36094cf6a16d3f71a1c666db'} savepoint resume: req=17 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
02:28:32 WARNING DIAGSTEP t=1790648912.324 total=113.0ms sched_done=0.3 drain_begin=0.2 drain_done=0.0 seed_slate_built=0.5 seed_drains_done=15.1 seed_batch_built=0.9 dseed_fwd_launched=73.5 dseed_sampled=15.6 dseed_observed=1.4 seed_launch_done=1.1 seed_device_drained=2.7 seed_forward_joined=0.1 seed_commit_done=1.2 step_end=0.3 step_begin=0.1
02:28:42 INFO    ✓ done#17 prompt=33133 cached=32768(99%) out=1669(reason=1508 content=161) ttft=0.115s total=10.626s gen=158.8tok/s kv=578.0MiB status=stop
02:28:42 INFO    {'request_id': 'd56c313629974d66a3ad827f3a22cf36'} savepoint resume: req=18 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
02:28:42 WARNING DIAGSTEP t=1790648922.953 total=113.3ms sched_done=0.2 drain_begin=0.1 drain_done=0.0 seed_slate_built=0.4 seed_drains_done=14.8 seed_batch_built=0.8 dseed_fwd_launched=73.6 dseed_sampled=16.3 dseed_observed=1.5 seed_launch_done=1.1 seed_device_drained=2.6 seed_forward_joined=0.1 seed_commit_done=1.2 step_end=0.3 step_begin=0.1
02:28:51 INFO    ✓ done#18 prompt=33150 cached=32768(99%) out=1314(reason=1158 content=156) ttft=0.114s total=8.322s gen=160.1tok/s kv=573.8MiB status=stop
02:28:56 WARNING DIAGSTEP t=1790648936.752 total=555.5ms sched_done=0.5 drain_begin=0.1 drain_done=0.0 seed_slate_built=2.2 seed_drains_done=0.0 seed_batch_built=1.6 dseed_fwd_launched=377.3 dseed_sampled=0.0 dseed_observed=14.1 seed_launch_done=0.0 seed_device_drained=158.8 seed_forward_joined=0.1 seed_commit_done=0.6 step_end=0.2 step_begin=0.1
02:28:56 INFO    ✓ done#19 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.689s total=5.692s gen=N/A kv=552.5MiB status=length
02:28:56 WARNING DIAGSTEP t=1790648936.859 total=107.2ms sched_done=0.8 drain_begin=0.2 drain_done=0.0 seed_slate_built=0.7 seed_drains_done=0.0 seed_batch_built=1.2 dseed_fwd_launched=79.1 dseed_sampled=15.1 dseed_observed=1.5 seed_launch_done=1.1 seed_device_drained=2.9 seed_forward_joined=0.1 seed_commit_done=3.5 step_end=0.2 step_begin=0.8
02:28:56 INFO    {'request_id': 'fc1d987387904ce68d948de7651b7cbb'} savepoint resume: req=20 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
02:28:56 WARNING DIAGSTEP t=1790648936.980 total=113.5ms sched_done=0.6 drain_begin=0.7 drain_done=0.0 seed_slate_built=0.5 seed_drains_done=15.1 seed_batch_built=0.9 dseed_fwd_launched=72.6 dseed_sampled=16.3 dseed_observed=1.4 seed_launch_done=1.1 seed_device_drained=2.7 seed_forward_joined=0.1 seed_commit_done=1.1 step_end=0.3 step_begin=0.1
02:29:04 INFO    ✓ done#20 prompt=33133 cached=32768(99%) out=1303(reason=1165 content=138) ttft=0.115s total=7.892s gen=167.5tok/s kv=573.8MiB status=stop
02:29:04 INFO    {'request_id': 'd89ec246ed7e434aaca4425173f19947'} savepoint resume: req=21 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
02:29:04 WARNING DIAGSTEP t=1790648944.876 total=113.8ms sched_done=0.2 drain_begin=0.1 drain_done=0.0 seed_slate_built=0.3 seed_drains_done=15.0 seed_batch_built=0.9 dseed_fwd_launched=72.7 dseed_sampled=16.8 dseed_observed=1.9 seed_launch_done=1.3 seed_device_drained=2.5 seed_forward_joined=0.1 seed_commit_done=1.4 step_end=0.3 step_begin=0.1
02:29:14 INFO    ✓ done#21 prompt=33150 cached=32768(99%) out=1413(reason=1252 content=161) ttft=0.114s total=9.400s gen=152.2tok/s kv=578.0MiB status=stop
02:29:19 WARNING DIAGSTEP t=1790648959.757 total=555.4ms sched_done=0.5 drain_begin=0.1 drain_done=0.0 seed_slate_built=2.2 seed_drains_done=0.0 seed_batch_built=1.6 dseed_fwd_launched=377.8 dseed_sampled=0.0 dseed_observed=14.0 seed_launch_done=0.0 seed_device_drained=158.3 seed_forward_joined=0.1 seed_commit_done=0.5 step_end=0.2 step_begin=0.1
02:29:19 INFO    ✓ done#22 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.693s total=5.696s gen=N/A kv=552.5MiB status=length
02:29:19 WARNING DIAGSTEP t=1790648959.865 total=107.5ms sched_done=0.7 drain_begin=0.1 drain_done=0.0 seed_slate_built=0.7 seed_drains_done=0.0 seed_batch_built=1.3 dseed_fwd_launched=77.9 dseed_sampled=16.1 dseed_observed=1.5 seed_launch_done=1.1 seed_device_drained=2.8 seed_forward_joined=0.1 seed_commit_done=3.8 step_end=1.0 step_begin=0.3
02:29:19 INFO    {'request_id': 'd6d3c3f30a7041dd8d90e952e215a18b'} savepoint resume: req=23 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
02:29:19 WARNING DIAGSTEP t=1790648959.987 total=114.2ms sched_done=0.3 drain_begin=0.2 drain_done=0.0 seed_slate_built=0.5 seed_drains_done=15.1 seed_batch_built=0.9 dseed_fwd_launched=74.8 dseed_sampled=15.3 dseed_observed=1.4 seed_launch_done=1.1 seed_device_drained=2.7 seed_forward_joined=0.1 seed_commit_done=1.2 step_end=0.3 step_begin=0.1
02:29:28 INFO    ✓ done#23 prompt=33133 cached=32768(99%) out=1190(reason=1021 content=169) ttft=0.117s total=9.108s gen=132.3tok/s kv=573.8MiB status=stop
02:29:28 INFO    {'request_id': '572fdd823cf74a79b6a843e965e3c129'} savepoint resume: req=24 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
02:29:29 WARNING DIAGSTEP t=1790648969.096 total=112.9ms sched_done=0.2 drain_begin=0.3 drain_done=0.0 seed_slate_built=0.4 seed_drains_done=14.8 seed_batch_built=0.7 dseed_fwd_launched=74.6 dseed_sampled=15.0 dseed_observed=1.4 seed_launch_done=1.1 seed_device_drained=2.7 seed_forward_joined=0.1 seed_commit_done=1.1 step_end=0.1 step_begin=0.2
02:29:38 INFO    ✓ done#24 prompt=33150 cached=32768(99%) out=1368(reason=1219 content=149) ttft=0.113s total=9.100s gen=152.2tok/s kv=573.8MiB status=stop
02:29:43 WARNING DIAGSTEP t=1790648983.681 total=556.3ms sched_done=0.5 drain_begin=0.1 drain_done=0.0 seed_slate_built=1.9 seed_drains_done=0.0 seed_batch_built=1.6 dseed_fwd_launched=378.3 dseed_sampled=0.0 dseed_observed=14.0 seed_launch_done=0.0 seed_device_drained=159.0 seed_forward_joined=0.1 seed_commit_done=0.5 step_end=0.2 step_begin=0.1
02:29:43 INFO    ✓ done#25 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.697s total=5.700s gen=N/A kv=552.5MiB status=length
02:29:43 WARNING DIAGSTEP t=1790648983.791 total=110.0ms sched_done=0.7 drain_begin=0.1 drain_done=0.0 seed_slate_built=0.7 seed_drains_done=0.0 seed_batch_built=1.2 dseed_fwd_launched=77.1 dseed_sampled=19.8 dseed_observed=1.5 seed_launch_done=1.1 seed_device_drained=2.9 seed_forward_joined=0.1 seed_commit_done=3.6 step_end=0.9 step_begin=0.3
02:29:43 INFO    {'request_id': 'dfa4b9d92e86499fbb855ba3b4f621fe'} savepoint resume: req=26 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
02:29:43 WARNING DIAGSTEP t=1790648983.913 total=113.2ms sched_done=0.3 drain_begin=0.3 drain_done=0.0 seed_slate_built=0.5 seed_drains_done=15.1 seed_batch_built=0.9 dseed_fwd_launched=72.9 dseed_sampled=16.3 dseed_observed=1.4 seed_launch_done=1.1 seed_device_drained=2.7 seed_forward_joined=0.1 seed_commit_done=1.1 step_end=0.3 step_begin=0.1
02:29:49 INFO    ✓ done#26 prompt=33133 cached=32768(99%) out=922(reason=775 content=147) ttft=0.116s total=5.858s gen=160.6tok/s kv=569.5MiB status=stop
02:29:49 INFO    {'request_id': '6f6c163afe3f4e03924266cddf8d6407'} savepoint resume: req=27 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
02:29:49 WARNING DIAGSTEP t=1790648989.774 total=114.3ms sched_done=0.3 drain_begin=0.4 drain_done=0.0 seed_slate_built=0.4 seed_drains_done=14.8 seed_batch_built=0.7 dseed_fwd_launched=74.1 dseed_sampled=16.9 dseed_observed=1.4 seed_launch_done=1.0 seed_device_drained=2.7 seed_forward_joined=0.1 seed_commit_done=1.1 step_end=0.2 step_begin=0.2
02:30:03 INFO    ✓ done#27 prompt=33150 cached=32768(99%) out=2048(reason=2048 content=0) ttft=0.115s total=14.254s gen=144.8tok/s kv=586.5MiB status=length
02:30:09 WARNING DIAGSTEP t=1790649009.507 total=556.2ms sched_done=0.5 drain_begin=0.1 drain_done=0.0 seed_slate_built=2.1 seed_drains_done=0.0 seed_batch_built=1.6 dseed_fwd_launched=378.0 dseed_sampled=0.0 dseed_observed=14.0 seed_launch_done=0.0 seed_device_drained=158.9 seed_forward_joined=0.1 seed_commit_done=0.6 step_end=0.0 step_begin=0.3
02:30:09 INFO    ✓ done#28 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.694s total=5.696s gen=N/A kv=552.5MiB status=length
02:30:09 WARNING DIAGSTEP t=1790649009.615 total=108.5ms sched_done=0.8 drain_begin=0.2 drain_done=0.0 seed_slate_built=0.7 seed_drains_done=0.0 seed_batch_built=1.4 dseed_fwd_launched=76.3 dseed_sampled=18.8 dseed_observed=1.4 seed_launch_done=1.0 seed_device_drained=2.9 seed_forward_joined=0.1 seed_commit_done=3.5 step_end=0.9 step_begin=0.2
02:30:09 INFO    {'request_id': '1b7bbe6ebcf1432ab4fd69329fba36bd'} savepoint resume: req=29 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
02:30:09 WARNING DIAGSTEP t=1790649009.738 total=115.0ms sched_done=0.6 drain_begin=0.7 drain_done=0.0 seed_slate_built=0.5 seed_drains_done=15.1 seed_batch_built=1.0 dseed_fwd_launched=77.3 dseed_sampled=12.9 dseed_observed=1.4 seed_launch_done=1.1 seed_device_drained=2.7 seed_forward_joined=0.1 seed_commit_done=1.2 step_end=0.3 step_begin=0.1
02:30:19 INFO    ✓ done#29 prompt=33133 cached=32768(99%) out=1432(reason=1271 content=161) ttft=0.117s total=9.560s gen=151.6tok/s kv=578.0MiB status=stop
02:30:19 INFO    {'request_id': 'feb7f9d429c14dfd947a8796b1785042'} savepoint resume: req=30 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
02:30:19 WARNING DIAGSTEP t=1790649019.299 total=113.9ms sched_done=0.2 drain_begin=0.3 drain_done=0.0 seed_slate_built=0.3 seed_drains_done=15.0 seed_batch_built=0.9 dseed_fwd_launched=73.9 dseed_sampled=16.0 dseed_observed=1.5 seed_launch_done=1.1 seed_device_drained=2.7 seed_forward_joined=0.1 seed_commit_done=1.2 step_end=0.3 step_begin=0.4
02:30:28 INFO    ✓ done#30 prompt=33150 cached=32768(99%) out=1298(reason=1175 content=123) ttft=0.114s total=9.288s gen=141.5tok/s kv=573.8MiB status=stop
