03:42:12 INFO    ✓ done#1 prompt=26013 cached=0(0%) out=600(reason=600 content=0) ttft=4.348s total=9.605s gen=114.1tok/s kv=442.0MiB status=length
03:42:12 INFO    {'request_id': '791c456e737e41fbafe390d2bfb012c5'} savepoint resume: req=2 covered=25856 of prompt_len=26247 depth_from_newest=0 entries=1
03:42:16 INFO    ✓ done#2 prompt=26247 cached=25856(99%) out=600(reason=600 content=0) ttft=0.129s total=4.131s gen=149.9tok/s kv=446.2MiB status=length
03:42:16 INFO    {'request_id': '6f875bc98aa14eed9a1f9ad305718d63'} savepoint resume: req=3 covered=26112 of prompt_len=26463 depth_from_newest=0 entries=2
03:42:20 INFO    ✓ done#3 prompt=26463 cached=26112(99%) out=600(reason=554 content=46) ttft=0.109s total=4.083s gen=151.0tok/s kv=450.5MiB status=length
03:42:20 INFO    {'request_id': '4a8f76fa24584d9389e94189f0447e6b'} savepoint resume: req=4 covered=26368 of prompt_len=26716 depth_from_newest=0 entries=3
03:42:24 INFO    ✓ done#4 prompt=26716 cached=26368(99%) out=600(reason=600 content=0) ttft=0.110s total=3.901s gen=158.3tok/s kv=454.8MiB status=length
03:42:31 INFO    ✓ done#5 prompt=15360 cached=0(0%) out=600(reason=541 content=59) ttft=2.464s total=6.659s gen=143.0tok/s kv=267.8MiB status=length
03:42:38 INFO    ✓ done#6 prompt=15626 cached=0(0%) out=600(reason=600 content=0) ttft=2.536s total=6.741s gen=142.7tok/s kv=272.0MiB status=length
03:42:38 INFO    {'request_id': '265d21da759a4256aa331a8b46564224'} savepoint resume: req=7 covered=15616 of prompt_len=15837 depth_from_newest=0 entries=6
03:42:43 INFO    ✓ done#7 prompt=15837 cached=15616(99%) out=600(reason=600 content=0) ttft=0.094s total=4.381s gen=140.0tok/s kv=276.2MiB status=length
03:42:48 INFO    ✓ done#8 prompt=24094 cached=0(0%) out=145 ttft=4.018s total=5.756s gen=83.5tok/s kv=403.8MiB status=stop
03:42:48 INFO    {'request_id': 'fabef6bd6cc34e32b353d5a319e3ae3e'} savepoint resume: req=9 covered=24064 of prompt_len=24444 depth_from_newest=0 entries=6
03:42:49 INFO    ✓ done#9 prompt=24444 cached=24064(98%) out=85 ttft=0.111s total=0.922s gen=104.8tok/s kv=408.0MiB status=stop
03:42:49 INFO    {'request_id': 'aed54c6b2d9346ea997abd77da5e4efe'} savepoint resume: req=10 covered=24320 of prompt_len=24759 depth_from_newest=0 entries=6
03:42:50 INFO    ✓ done#10 prompt=24759 cached=24320(98%) out=113 ttft=0.130s total=1.051s gen=122.7tok/s kv=416.5MiB status=stop
03:42:50 INFO    {'request_id': 'cb05a75bab0941ea8b41f5a9656db9d3'} savepoint resume: req=11 covered=24576 of prompt_len=25076 depth_from_newest=0 entries=6
03:42:52 INFO    ✓ done#11 prompt=25076 cached=24576(98%) out=145 ttft=0.135s total=1.328s gen=121.6tok/s kv=420.8MiB status=stop
