01:56:48 INFO    ✓ done#1 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.658s total=5.666s gen=N/A kv=552.5MiB status=length
01:56:48 INFO    {'request_id': 'eca2eec390aa4979a895ad61479d8452'} savepoint crossing writes armed for tenant '_global': a request's radix walk reached 32768 tokens of a stored prefix but the deepest savepoint it could resume from covers 0, so a crossing write at the governor line between them (every 2048 tokens) would have served it. This tenant's prefills write crossings from now on; partial_match_lost_total counts the requests this one and any later ones cost.
01:57:02 INFO    ✓ done#2 prompt=33133 cached=0(0%) out=1158(reason=993 content=165) ttft=5.678s total=14.295s gen=134.4tok/s kv=569.5MiB status=stop
01:57:02 INFO    {'request_id': '7d11a26101484a4097efc875bcb5d5c5'} savepoint resume: req=3 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:57:15 INFO    ✓ done#3 prompt=33150 cached=32768(99%) out=1883(reason=1740 content=143) ttft=0.118s total=12.534s gen=151.7tok/s kv=582.2MiB status=stop
01:57:20 INFO    ✓ done#4 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.692s total=5.695s gen=N/A kv=552.5MiB status=length
01:57:20 INFO    {'request_id': 'b1c719856fbc4de49cac07cde0a6f321'} savepoint resume: req=5 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
01:57:26 INFO    ✓ done#5 prompt=33133 cached=32768(99%) out=729(reason=570 content=159) ttft=0.117s total=5.417s gen=137.5tok/s kv=565.2MiB status=stop
01:57:26 INFO    {'request_id': 'ad864108f2044af58480bfcb0d2caa41'} savepoint resume: req=6 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:57:34 INFO    ✓ done#6 prompt=33150 cached=32768(99%) out=1191(reason=1023 content=168) ttft=0.135s total=8.201s gen=147.7tok/s kv=573.8MiB status=stop
01:57:40 INFO    ✓ done#7 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.705s total=5.708s gen=N/A kv=552.5MiB status=length
01:57:40 INFO    {'request_id': '4ea013ba18264c69bea702e8ba97726f'} savepoint resume: req=8 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
01:57:55 INFO    ✓ done#8 prompt=33133 cached=32768(99%) out=2048(reason=1945 content=103) ttft=0.117s total=14.936s gen=138.2tok/s kv=586.5MiB status=length
01:57:55 INFO    {'request_id': 'c173d3a4b59c408f8a17fd0ae3ca1dd4'} savepoint resume: req=9 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:58:00 INFO    ✓ done#9 prompt=33150 cached=32768(99%) out=811(reason=684 content=127) ttft=0.117s total=5.054s gen=164.3tok/s kv=565.2MiB status=stop
01:58:05 INFO    ✓ done#10 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.708s total=5.711s gen=N/A kv=552.5MiB status=length
01:58:05 INFO    {'request_id': '62ab609c59dc42d79963ab2ca0015e44'} savepoint resume: req=11 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
01:58:09 INFO    ✓ done#11 prompt=33133 cached=32768(99%) out=461(reason=342 content=119) ttft=0.118s total=3.931s gen=120.9tok/s kv=561.0MiB status=stop
01:58:09 INFO    {'request_id': 'eb2034e2454f47e189dd21e65e627f88'} savepoint resume: req=12 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:58:17 INFO    ✓ done#12 prompt=33150 cached=32768(99%) out=1170(reason=1003 content=167) ttft=0.118s total=7.488s gen=158.8tok/s kv=573.8MiB status=stop
01:58:23 INFO    ✓ done#13 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.712s total=5.715s gen=N/A kv=552.5MiB status=length
01:58:23 INFO    {'request_id': '2a0188010a6a4c97878417158b12cd73'} savepoint resume: req=14 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
01:58:27 INFO    ✓ done#14 prompt=33133 cached=32768(99%) out=552(reason=396 content=156) ttft=0.119s total=4.660s gen=121.6tok/s kv=561.0MiB status=stop
01:58:27 INFO    {'request_id': '10eb00d0b2f748019f732c67e8fafe5f'} savepoint resume: req=15 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:58:38 INFO    ✓ done#15 prompt=33150 cached=32768(99%) out=1509(reason=1357 content=152) ttft=0.117s total=10.590s gen=144.1tok/s kv=578.0MiB status=stop
01:58:44 INFO    ✓ done#16 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.716s total=5.719s gen=N/A kv=552.5MiB status=length
01:58:44 INFO    {'request_id': '0f8e639502004906a1c53eac9472b8f1'} savepoint resume: req=17 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
01:58:51 INFO    ✓ done#17 prompt=33133 cached=32768(99%) out=914(reason=762 content=152) ttft=0.119s total=6.981s gen=133.2tok/s kv=565.2MiB status=stop
01:58:51 INFO    {'request_id': '0bf872907075435c85bac010ec2a5f7b'} savepoint resume: req=18 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:58:55 INFO    ✓ done#18 prompt=33150 cached=32768(99%) out=614(reason=438 content=176) ttft=0.115s total=4.531s gen=139.1tok/s kv=561.0MiB status=stop
