00:13:14 INFO    ✗ done#-1 prompt=4096 cached=0(0%) out=33 ttft=- total=- gen=21.6tok/s kv=72.2MiB status=boot_realization
00:13:14 INFO    ✗ done#-2 prompt=256 cached=0(0%) out=25 ttft=- total=- gen=21.4tok/s kv=8.5MiB status=boot_realization
00:13:14 INFO    ✗ done#-3 prompt=256 cached=0(0%) out=116 ttft=- total=- gen=99.2tok/s kv=8.5MiB status=boot_realization
00:13:14 INFO    ✗ done#-4 prompt=256 cached=0(0%) out=1 ttft=- total=- gen=N/A kv=8.5MiB status=boot_realization
00:13:17 INFO    ✗ done#-1 prompt=4096 cached=0(0%) out=93 ttft=- total=- gen=141.6tok/s kv=72.2MiB status=boot_realization
00:13:17 INFO    ✗ done#-2 prompt=256 cached=0(0%) out=22 ttft=- total=- gen=46.5tok/s kv=8.5MiB status=boot_realization
00:13:17 INFO    ✗ done#-3 prompt=256 cached=0(0%) out=15 ttft=- total=- gen=31.7tok/s kv=8.5MiB status=boot_realization
00:13:17 INFO    ✗ done#-4 prompt=256 cached=0(0%) out=1 ttft=- total=- gen=N/A kv=8.5MiB status=boot_realization
00:13:33 INFO    ✓ done#1 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.449s total=5.467s gen=N/A kv=552.5MiB status=length
00:13:33 INFO    {'request_id': 'c932a1b757ef4e66b75274c42d92f938'} savepoint crossing writes armed for tenant '_global': a request's radix walk reached 32768 tokens of a stored prefix but the deepest savepoint it could resume from covers 0, so a crossing write at the governor line between them (every 2048 tokens) would have served it. This tenant's prefills write crossings from now on; partial_match_lost_total counts the requests this one and any later ones cost.
00:13:39 INFO    ✓ done#2 prompt=33133 cached=0(0%) out=64(reason=64 content=0) ttft=5.446s total=5.779s gen=192.3tok/s kv=552.5MiB status=length
00:13:39 INFO    {'request_id': 'b0f1f672c97c4817a3dc224ef4bfa8fe'} savepoint resume: req=3 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
00:13:39 INFO    ✓ done#3 prompt=33150 cached=32768(99%) out=64(reason=64 content=0) ttft=0.124s total=0.424s gen=213.5tok/s kv=552.5MiB status=length
00:13:45 INFO    ✓ done#4 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.447s total=5.451s gen=N/A kv=552.5MiB status=length
00:13:45 INFO    {'request_id': '0fc655ec264c4eb7a0550fefbccbabda'} savepoint resume: req=5 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
00:13:45 INFO    ✓ done#5 prompt=33133 cached=32768(99%) out=64(reason=64 content=0) ttft=0.123s total=0.398s gen=233.2tok/s kv=552.5MiB status=length
00:13:45 INFO    {'request_id': '69c4c1d6844746a3b6b97fef6104bbcb'} savepoint resume: req=6 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
00:13:46 INFO    ✓ done#6 prompt=33150 cached=32768(99%) out=64(reason=64 content=0) ttft=0.117s total=0.631s gen=124.7tok/s kv=552.5MiB status=length
00:13:51 INFO    ✓ done#7 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.453s total=5.457s gen=N/A kv=552.5MiB status=length
00:13:51 INFO    {'request_id': '49541e84defa461ba07bb4bf8cde13b8'} savepoint resume: req=8 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
00:13:52 INFO    ✓ done#8 prompt=33133 cached=32768(99%) out=64(reason=64 content=0) ttft=0.138s total=0.493s gen=180.2tok/s kv=552.5MiB status=length
00:13:52 INFO    {'request_id': 'a11ddc7397ee4fa48b8a3187fbf25536'} savepoint resume: req=9 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
00:13:52 INFO    ✓ done#9 prompt=33150 cached=32768(99%) out=64(reason=64 content=0) ttft=0.134s total=0.436s gen=212.1tok/s kv=552.5MiB status=length
00:13:58 INFO    ✓ done#10 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.455s total=5.459s gen=N/A kv=552.5MiB status=length
00:13:58 INFO    {'request_id': 'fe3a7ed7fab24db6a9cb4c98675c27dd'} savepoint resume: req=11 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
00:13:58 INFO    ✓ done#11 prompt=33133 cached=32768(99%) out=64(reason=64 content=0) ttft=0.122s total=0.370s gen=258.6tok/s kv=552.5MiB status=length
00:13:58 INFO    {'request_id': 'fafa8d68c62c4526b9f7e2c0953b3ab9'} savepoint resume: req=12 covered=32768 of prompt_len=33152 depth_from_newest=0 entries=6
00:13:58 INFO    ✓ done#12 prompt=33152 cached=32768(99%) out=64(reason=64 content=0) ttft=0.117s total=0.471s gen=180.6tok/s kv=552.5MiB status=length
00:14:04 INFO    ✓ done#13 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.454s total=5.457s gen=N/A kv=552.5MiB status=length
00:14:04 INFO    {'request_id': 'a91768735cde49379ebd5be776a33e2b'} savepoint resume: req=14 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
00:14:04 INFO    ✓ done#14 prompt=33133 cached=32768(99%) out=64(reason=64 content=0) ttft=0.122s total=0.477s gen=180.4tok/s kv=552.5MiB status=length
00:14:04 INFO    {'request_id': '3ea988e2e6c64a3d86f3b64a27c29c4c'} savepoint resume: req=15 covered=32768 of prompt_len=33152 depth_from_newest=0 entries=6
00:14:05 INFO    ✓ done#15 prompt=33152 cached=32768(99%) out=64(reason=64 content=0) ttft=0.134s total=0.516s gen=167.7tok/s kv=552.5MiB status=length
00:14:10 INFO    ✓ done#16 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.461s total=5.464s gen=N/A kv=552.5MiB status=length
00:14:10 INFO    {'request_id': '4d86eae2f8d146bfa66f7b74a254fa95'} savepoint resume: req=17 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
00:14:11 INFO    ✓ done#17 prompt=33133 cached=32768(99%) out=64(reason=64 content=0) ttft=0.122s total=0.503s gen=168.1tok/s kv=552.5MiB status=length
00:14:11 INFO    {'request_id': 'bc52123f9de64fc78430db28bf254257'} savepoint resume: req=18 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
00:14:11 INFO    ✓ done#18 prompt=33150 cached=32768(99%) out=64(reason=64 content=0) ttft=0.118s total=0.419s gen=213.0tok/s kv=552.5MiB status=length
