23:37:21 INFO    ✗ done#-1 prompt=4096 cached=0(0%) out=33 ttft=- total=- gen=41.2tok/s kv=72.2MiB status=boot_realization
23:37:21 INFO    ✗ done#-2 prompt=256 cached=0(0%) out=25 ttft=- total=- gen=40.9tok/s kv=8.5MiB status=boot_realization
23:37:21 INFO    ✗ done#-3 prompt=256 cached=0(0%) out=116 ttft=- total=- gen=189.6tok/s kv=8.5MiB status=boot_realization
23:37:22 INFO    ✗ done#-4 prompt=256 cached=0(0%) out=1 ttft=- total=- gen=N/A kv=8.5MiB status=boot_realization
23:37:25 INFO    ✗ done#-1 prompt=4096 cached=0(0%) out=91 ttft=- total=- gen=139.3tok/s kv=72.2MiB status=boot_realization
23:37:25 INFO    ✗ done#-2 prompt=256 cached=0(0%) out=23 ttft=- total=- gen=48.8tok/s kv=8.5MiB status=boot_realization
23:37:25 INFO    ✗ done#-3 prompt=256 cached=0(0%) out=15 ttft=- total=- gen=31.8tok/s kv=8.5MiB status=boot_realization
23:37:25 INFO    ✗ done#-4 prompt=256 cached=0(0%) out=1 ttft=- total=- gen=N/A kv=8.5MiB status=boot_realization
23:37:40 INFO    ✓ done#1 prompt=32843 cached=0(0%) out=1(reason=1 content=0) ttft=5.794s total=5.838s gen=N/A kv=548.2MiB status=length
23:37:40 INFO    {'request_id': '106b777a46d74393a3fca9a62fddc92f'} savepoint resume: req=2 covered=32768 of prompt_len=33187 depth_from_newest=0 entries=1
23:37:40 INFO    ✓ done#2 prompt=33187 cached=32768(99%) out=64(reason=64 content=0) ttft=0.135s total=0.466s gen=193.4tok/s kv=552.5MiB status=length
23:37:40 INFO    {'request_id': '0e23b1323a0447f996fce9d13afbcbf6'} savepoint resume: req=3 covered=32768 of prompt_len=33130 depth_from_newest=0 entries=2
23:37:41 INFO    ✓ done#3 prompt=33130 cached=32768(99%) out=64(reason=64 content=0) ttft=0.112s total=0.643s gen=120.5tok/s kv=552.5MiB status=length
23:37:41 INFO    {'request_id': '6493d0c4dae342bd9b6d8f64d1a49039'} savepoint resume: req=4 covered=32768 of prompt_len=33136 depth_from_newest=0 entries=3
23:37:42 INFO    ✓ done#4 prompt=33136 cached=32768(99%) out=64(reason=64 content=0) ttft=0.113s total=0.441s gen=195.0tok/s kv=552.5MiB status=length
23:37:42 INFO    {'request_id': '1dd1794ce2f34db8a9c4791705362941'} savepoint resume: req=5 covered=32768 of prompt_len=33131 depth_from_newest=0 entries=4
23:37:42 INFO    ✓ done#5 prompt=33131 cached=32768(99%) out=64(reason=64 content=0) ttft=0.121s total=0.369s gen=258.0tok/s kv=552.5MiB status=length
23:37:48 INFO    ✓ done#6 prompt=32843 cached=0(0%) out=1(reason=1 content=0) ttft=5.788s total=5.790s gen=N/A kv=548.2MiB status=length
23:37:48 INFO    {'request_id': 'e1910adfe9f249d6ba65f9dc757e536d'} savepoint resume: req=7 covered=32768 of prompt_len=33125 depth_from_newest=0 entries=1
23:37:48 INFO    ✓ done#7 prompt=33125 cached=32768(99%) out=64(reason=64 content=0) ttft=0.111s total=0.360s gen=257.1tok/s kv=552.5MiB status=length
23:37:48 INFO    {'request_id': 'efbd2fa59ab94c4291a11993e9b4278b'} savepoint resume: req=8 covered=32768 of prompt_len=33117 depth_from_newest=0 entries=2
23:37:49 INFO    ✓ done#8 prompt=33117 cached=32768(99%) out=64(reason=64 content=0) ttft=0.110s total=0.412s gen=212.0tok/s kv=552.5MiB status=length
23:37:49 INFO    {'request_id': '7858aea0df9849e3ba6b01e5fad14772'} savepoint resume: req=9 covered=32768 of prompt_len=33078 depth_from_newest=0 entries=3
23:37:49 INFO    ✓ done#9 prompt=33078 cached=32768(99%) out=64(reason=64 content=0) ttft=0.105s total=0.594s gen=130.8tok/s kv=552.5MiB status=length
23:37:49 INFO    {'request_id': 'b79b1f50005248c680d472ee6579cc97'} savepoint resume: req=10 covered=32768 of prompt_len=33087 depth_from_newest=0 entries=4
23:37:50 INFO    ✓ done#10 prompt=33087 cached=32768(99%) out=64(reason=64 content=0) ttft=0.106s total=0.408s gen=212.0tok/s kv=552.5MiB status=length
