00:08:08 INFO    ✗ done#-1 prompt=4096 cached=0(0%) out=33 ttft=- total=- gen=39.0tok/s kv=72.2MiB status=boot_realization
00:08:08 INFO    ✗ done#-2 prompt=256 cached=0(0%) out=25 ttft=- total=- gen=37.9tok/s kv=8.5MiB status=boot_realization
00:08:08 INFO    ✗ done#-3 prompt=256 cached=0(0%) out=116 ttft=- total=- gen=175.7tok/s kv=8.5MiB status=boot_realization
00:08:08 INFO    ✗ done#-4 prompt=256 cached=0(0%) out=1 ttft=- total=- gen=N/A kv=8.5MiB status=boot_realization
00:08:11 INFO    ✗ done#-1 prompt=4096 cached=0(0%) out=93 ttft=- total=- gen=143.0tok/s kv=72.2MiB status=boot_realization
00:08:11 INFO    ✗ done#-2 prompt=256 cached=0(0%) out=22 ttft=- total=- gen=46.7tok/s kv=8.5MiB status=boot_realization
00:08:11 INFO    ✗ done#-3 prompt=256 cached=0(0%) out=15 ttft=- total=- gen=31.8tok/s kv=8.5MiB status=boot_realization
00:08:11 INFO    ✗ done#-4 prompt=256 cached=0(0%) out=1 ttft=- total=- gen=N/A kv=8.5MiB status=boot_realization
00:08:23 INFO    ✓ done#1 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.455s total=5.665s gen=N/A kv=552.5MiB status=length
00:08:23 INFO    {'request_id': '96b9b51778fb4abc84f8bd4554c0a30b'} savepoint crossing writes armed for tenant '_global': a request's radix walk reached 32768 tokens of a stored prefix but the deepest savepoint it could resume from covers 0, so a crossing write at the governor line between them (every 2048 tokens) would have served it. This tenant's prefills write crossings from now on; partial_match_lost_total counts the requests this one and any later ones cost.
00:08:30 INFO    ✓ done#2 prompt=33133 cached=0(0%) out=64(reason=64 content=0) ttft=6.748s total=7.112s gen=176.1tok/s kv=552.5MiB status=length
00:08:30 INFO    {'request_id': 'e755eb5fb6334b16abac2c86ec3dfbf3'} savepoint resume: req=3 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
00:08:31 INFO    ✓ done#3 prompt=33150 cached=32768(99%) out=64(reason=64 content=0) ttft=0.213s total=0.625s gen=155.4tok/s kv=552.5MiB status=length
00:08:37 INFO    ✓ done#4 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=6.674s total=6.678s gen=N/A kv=552.5MiB status=length
00:08:37 INFO    {'request_id': '415e0ebbd15f4cb286290cb7e98387e7'} savepoint resume: req=5 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
00:08:38 INFO    ✓ done#5 prompt=33133 cached=32768(99%) out=64(reason=64 content=0) ttft=0.122s total=0.502s gen=168.1tok/s kv=552.5MiB status=length
00:08:38 INFO    {'request_id': '2c510470e57e4193806bcf09e2142264'} savepoint resume: req=6 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
00:08:38 INFO    ✓ done#6 prompt=33150 cached=32768(99%) out=64(reason=64 content=0) ttft=0.117s total=0.445s gen=195.2tok/s kv=552.5MiB status=length
00:08:44 INFO    ✓ done#7 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.472s total=5.477s gen=N/A kv=552.5MiB status=length
00:08:44 INFO    {'request_id': '304e9740936b4cef9ebba813478740e7'} savepoint resume: req=8 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
00:08:44 INFO    ✓ done#8 prompt=33133 cached=32768(99%) out=64(reason=64 content=0) ttft=0.130s total=0.458s gen=195.2tok/s kv=552.5MiB status=length
00:08:44 INFO    {'request_id': 'd718551b9d274d0eae7c644876a8620c'} savepoint resume: req=9 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
00:08:45 INFO    ✓ done#9 prompt=33150 cached=32768(99%) out=64(reason=64 content=0) ttft=0.121s total=0.531s gen=156.3tok/s kv=552.5MiB status=length
00:08:50 INFO    ✓ done#10 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.466s total=5.470s gen=N/A kv=552.5MiB status=length
00:08:50 INFO    {'request_id': 'b608f1ae96574c2eba2f68bd95bf89cc'} savepoint resume: req=11 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
00:08:51 INFO    ✓ done#11 prompt=33133 cached=32768(99%) out=64(reason=64 content=0) ttft=0.123s total=0.478s gen=180.4tok/s kv=552.5MiB status=length
00:08:51 INFO    {'request_id': '4ec9e4366d9f4bb0b394fd92396b61ef'} savepoint resume: req=12 covered=32768 of prompt_len=33152 depth_from_newest=0 entries=6
00:08:51 INFO    ✓ done#12 prompt=33152 cached=32768(99%) out=64(reason=64 content=0) ttft=0.120s total=0.475s gen=180.2tok/s kv=552.5MiB status=length
00:08:57 INFO    ✓ done#13 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.570s total=6.053s gen=N/A kv=552.5MiB status=length
00:08:57 INFO    {'request_id': 'fe4e6ad1eab546bfa7d28d95834648e0'} savepoint resume: req=14 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
00:08:58 INFO    ✓ done#14 prompt=33133 cached=32768(99%) out=64(reason=64 content=0) ttft=0.125s total=0.506s gen=168.1tok/s kv=552.5MiB status=length
00:08:58 INFO    {'request_id': '47e61ec95b13498c8f78977043ed1f45'} savepoint resume: req=15 covered=32768 of prompt_len=33152 depth_from_newest=0 entries=6
00:08:58 INFO    ✓ done#15 prompt=33152 cached=32768(99%) out=64(reason=64 content=0) ttft=0.118s total=0.472s gen=180.8tok/s kv=552.5MiB status=length
00:09:04 INFO    ✓ done#16 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.462s total=5.466s gen=N/A kv=552.5MiB status=length
00:09:04 INFO    {'request_id': '7ca5df960e30412d8fa57aa11d465bbb'} savepoint resume: req=17 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
00:09:04 INFO    ✓ done#17 prompt=33133 cached=32768(99%) out=64(reason=64 content=0) ttft=0.121s total=0.475s gen=180.7tok/s kv=552.5MiB status=length
00:09:05 INFO    {'request_id': '6418a5643b2e462ea6592777fc1cba92'} savepoint resume: req=18 covered=32768 of prompt_len=33152 depth_from_newest=0 entries=6
00:09:05 INFO    ✓ done#18 prompt=33152 cached=32768(99%) out=64(reason=64 content=0) ttft=0.119s total=0.394s gen=232.6tok/s kv=552.5MiB status=length
00:09:19 INFO    ✓ done#19 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=13.661s total=13.724s gen=N/A kv=552.5MiB status=length
00:09:19 INFO    {'request_id': '84d9ebcd097c4ffdaffe7288d096c09e'} savepoint resume: req=20 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
00:09:19 INFO    ✓ done#20 prompt=33133 cached=32768(99%) out=64(reason=64 content=0) ttft=0.107s total=0.545s gen=146.1tok/s kv=552.5MiB status=length
00:09:20 INFO    {'request_id': 'd50316b3db914863acb951302ccc4160'} savepoint resume: req=21 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
00:09:20 INFO    ✓ done#21 prompt=33150 cached=32768(99%) out=64(reason=64 content=0) ttft=0.107s total=0.380s gen=234.1tok/s kv=552.5MiB status=length
