01:39:51 INFO    ✓ done#1 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.649s total=5.657s gen=N/A kv=552.5MiB status=length
01:39:51 INFO    {'request_id': '030213a099a945fc856cc3ef4df2b109'} savepoint crossing writes armed for tenant '_global': a request's radix walk reached 32768 tokens of a stored prefix but the deepest savepoint it could resume from covers 0, so a crossing write at the governor line between them (every 2048 tokens) would have served it. This tenant's prefills write crossings from now on; partial_match_lost_total counts the requests this one and any later ones cost.
01:40:05 INFO    ✓ done#2 prompt=33133 cached=0(0%) out=1158(reason=993 content=165) ttft=5.671s total=14.280s gen=134.5tok/s kv=569.5MiB status=stop
01:40:05 INFO    {'request_id': '158de34bef414a3fbcd0f6e0a7f8b989'} savepoint resume: req=3 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:40:17 INFO    ✓ done#3 prompt=33150 cached=32768(99%) out=1711(reason=1590 content=121) ttft=0.117s total=11.772s gen=146.8tok/s kv=582.2MiB status=stop
01:40:22 INFO    ✓ done#4 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.685s total=5.688s gen=N/A kv=552.5MiB status=length
01:40:22 INFO    {'request_id': '8ac4fb0d8ec147e9b681e8303b17e456'} savepoint resume: req=5 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
01:40:31 INFO    ✓ done#5 prompt=33133 cached=32768(99%) out=1189(reason=1027 content=162) ttft=0.118s total=8.779s gen=137.3tok/s kv=573.8MiB status=stop
01:40:31 INFO    {'request_id': '808ace4feee9483ab8188c07a870f1fe'} savepoint resume: req=6 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:40:42 INFO    ✓ done#6 prompt=33150 cached=32768(99%) out=1497(reason=1340 content=157) ttft=0.116s total=10.412s gen=145.4tok/s kv=578.0MiB status=stop
01:40:47 INFO    ✓ done#7 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.694s total=5.698s gen=N/A kv=552.5MiB status=length
01:40:47 INFO    {'request_id': '2b1655bddee44240ab4733658c110399'} savepoint resume: req=8 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
01:40:55 INFO    ✓ done#8 prompt=33133 cached=32768(99%) out=1088(reason=909 content=179) ttft=0.116s total=7.523s gen=146.9tok/s kv=569.5MiB status=stop
01:40:55 INFO    {'request_id': '74e88eafdadb4f49b8e90250cb72b902'} savepoint resume: req=9 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:41:01 INFO    ✓ done#9 prompt=33150 cached=32768(99%) out=840(reason=636 content=204) ttft=0.116s total=5.983s gen=143.2tok/s kv=565.2MiB status=stop
01:41:07 INFO    ✓ done#10 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.699s total=5.702s gen=N/A kv=552.5MiB status=length
01:41:07 INFO    {'request_id': '5e9d7bbb2e474556873811c02158729f'} savepoint resume: req=11 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
01:41:16 INFO    ✓ done#11 prompt=33133 cached=32768(99%) out=1437(reason=1281 content=156) ttft=0.118s total=9.402s gen=154.8tok/s kv=578.0MiB status=stop
01:41:16 INFO    {'request_id': '62acb003d1e141a1a0d6a489af16e083'} savepoint resume: req=12 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:41:23 INFO    ✓ done#12 prompt=33150 cached=32768(99%) out=1023(reason=844 content=179) ttft=0.117s total=6.538s gen=159.3tok/s kv=569.5MiB status=stop
01:41:28 INFO    ✓ done#13 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.700s total=5.703s gen=N/A kv=552.5MiB status=length
01:41:28 INFO    {'request_id': '905d2d28f7554b5fa26d1182ccd01d74'} savepoint resume: req=14 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
01:41:39 INFO    ✓ done#14 prompt=33133 cached=32768(99%) out=1460(reason=1332 content=128) ttft=0.116s total=10.331s gen=142.9tok/s kv=578.0MiB status=stop
01:41:39 INFO    {'request_id': 'c59ff5d0254e45b4920b1607b631f188'} savepoint resume: req=15 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:41:46 INFO    ✓ done#15 prompt=33150 cached=32768(99%) out=1046(reason=899 content=147) ttft=0.116s total=7.017s gen=151.6tok/s kv=569.5MiB status=stop
01:41:51 INFO    ✓ done#16 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.704s total=5.707s gen=N/A kv=552.5MiB status=length
01:41:51 INFO    {'request_id': 'd6687107d46e4317b2d927e3d2111747'} savepoint resume: req=17 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
01:41:59 INFO    ✓ done#17 prompt=33133 cached=32768(99%) out=1014(reason=883 content=131) ttft=0.118s total=7.305s gen=141.1tok/s kv=569.5MiB status=stop
01:41:59 INFO    {'request_id': '62a77da44e124f3bad1325ba3a4e9786'} savepoint resume: req=18 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:42:07 INFO    ✓ done#18 prompt=33150 cached=32768(99%) out=1329(reason=1203 content=126) ttft=0.117s total=8.246s gen=163.5tok/s kv=573.8MiB status=stop
01:42:13 INFO    ✓ done#19 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.703s total=5.706s gen=N/A kv=552.5MiB status=length
01:42:13 INFO    {'request_id': '1f703bb9ce984f17a14364d2303e35f7'} savepoint resume: req=20 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
01:42:18 INFO    ✓ done#20 prompt=33133 cached=32768(99%) out=704(reason=583 content=121) ttft=0.115s total=4.933s gen=146.1tok/s kv=565.2MiB status=stop
01:42:18 INFO    {'request_id': 'fdf9041bcc96420ea1550f54d8ef6418'} savepoint resume: req=21 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:42:28 INFO    ✓ done#21 prompt=33150 cached=32768(99%) out=1394(reason=1271 content=123) ttft=0.116s total=10.360s gen=136.1tok/s kv=573.8MiB status=stop
01:42:34 INFO    ✓ done#22 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.707s total=5.712s gen=N/A kv=552.5MiB status=length
01:42:34 INFO    {'request_id': '3d15d7b0f34c4623b2a9139be3ccae78'} savepoint resume: req=23 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
01:42:40 INFO    ✓ done#23 prompt=33133 cached=32768(99%) out=917(reason=756 content=161) ttft=0.118s total=6.045s gen=154.7tok/s kv=569.5MiB status=stop
01:42:40 INFO    {'request_id': '86ff9996d19d4cf799721f63391c16e6'} savepoint resume: req=24 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:42:51 INFO    ✓ done#24 prompt=33150 cached=32768(99%) out=1708(reason=1566 content=142) ttft=0.116s total=11.569s gen=149.1tok/s kv=582.2MiB status=stop
01:42:57 INFO    ✓ done#25 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.719s total=5.722s gen=N/A kv=552.5MiB status=length
01:42:57 INFO    {'request_id': 'c45107bcca7947bd98c542859ff7471d'} savepoint resume: req=26 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
01:43:03 INFO    ✓ done#26 prompt=33133 cached=32768(99%) out=1005(reason=851 content=154) ttft=0.117s total=6.264s gen=163.5tok/s kv=569.5MiB status=stop
01:43:03 INFO    {'request_id': 'fbf65ecbb4f74a13b74b199689e50a81'} savepoint resume: req=27 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:43:13 INFO    ✓ done#27 prompt=33150 cached=32768(99%) out=1649(reason=1482 content=167) ttft=0.115s total=10.224s gen=163.1tok/s kv=578.0MiB status=stop
01:43:19 INFO    ✓ done#28 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.710s total=5.713s gen=N/A kv=552.5MiB status=length
01:43:19 INFO    {'request_id': '96eb77a5a1f94c628388d884a6f47047'} savepoint resume: req=29 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
01:43:22 INFO    ✓ done#29 prompt=33133 cached=32768(99%) out=371(reason=235 content=136) ttft=0.119s total=2.568s gen=151.5tok/s kv=556.8MiB status=stop
01:43:22 INFO    {'request_id': '6b9168fd1ef64cd2bc2171c57f600512'} savepoint resume: req=30 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:43:27 INFO    ✓ done#30 prompt=33150 cached=32768(99%) out=703(reason=553 content=150) ttft=0.116s total=5.707s gen=125.7tok/s kv=565.2MiB status=stop
01:43:33 INFO    ✓ done#31 prompt=33138 cached=0(0%) out=1(reason=1 content=0) ttft=5.710s total=5.713s gen=N/A kv=552.5MiB status=length
01:43:33 INFO    {'request_id': '8fb2e449afae4ba5bba3d3684e66d3e3'} savepoint resume: req=32 covered=32768 of prompt_len=33133 depth_from_newest=0 entries=6
01:43:41 INFO    ✓ done#32 prompt=33133 cached=32768(99%) out=1003(reason=859 content=144) ttft=0.117s total=7.517s gen=135.5tok/s kv=569.5MiB status=stop
01:43:41 INFO    {'request_id': '435cfba3ec8541bfa010fc0e62ac6c85'} savepoint resume: req=33 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=6
01:43:51 INFO    ✓ done#33 prompt=33150 cached=32768(99%) out=1438(reason=1303 content=135) ttft=0.115s total=10.285s gen=141.4tok/s kv=578.0MiB status=stop
