00:05:30 INFO    ✗ done#-1 prompt=4096 cached=0(0%) out=33 ttft=- total=- gen=39.4tok/s kv=72.2MiB status=boot_realization
00:05:30 INFO    ✗ done#-2 prompt=256 cached=0(0%) out=25 ttft=- total=- gen=38.4tok/s kv=8.5MiB status=boot_realization
00:05:30 INFO    ✗ done#-3 prompt=256 cached=0(0%) out=116 ttft=- total=- gen=178.3tok/s kv=8.5MiB status=boot_realization
00:05:30 INFO    ✗ done#-4 prompt=256 cached=0(0%) out=1 ttft=- total=- gen=N/A kv=8.5MiB status=boot_realization
00:05:33 INFO    ✗ done#-1 prompt=4096 cached=0(0%) out=93 ttft=- total=- gen=143.9tok/s kv=72.2MiB status=boot_realization
00:05:33 INFO    ✗ done#-2 prompt=256 cached=0(0%) out=22 ttft=- total=- gen=46.9tok/s kv=8.5MiB status=boot_realization
00:05:33 INFO    ✗ done#-3 prompt=256 cached=0(0%) out=15 ttft=- total=- gen=32.0tok/s kv=8.5MiB status=boot_realization
00:05:33 INFO    ✗ done#-4 prompt=256 cached=0(0%) out=1 ttft=- total=- gen=N/A kv=8.5MiB status=boot_realization
00:05:48 INFO    ✓ done#1 prompt=32843 cached=0(0%) out=1(reason=1 content=0) ttft=5.421s total=5.445s gen=N/A kv=548.2MiB status=length
00:05:48 INFO    {'request_id': '8964ec7440e2449eba7ec7d4b2c182f8'} savepoint resume: req=2 covered=32768 of prompt_len=32843 depth_from_newest=0 entries=1
00:05:48 INFO    ✓ done#2 prompt=32843 cached=32768(100%) out=64(reason=64 content=0) ttft=0.098s total=0.557s gen=139.4tok/s kv=548.2MiB status=length
00:05:48 INFO    {'request_id': 'd8fc55296a224234926822cbfc648378'} savepoint resume: req=3 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=1
00:05:49 INFO    ✓ done#3 prompt=33150 cached=32768(99%) out=64(reason=64 content=0) ttft=0.119s total=0.420s gen=212.5tok/s kv=552.5MiB status=length
00:05:54 INFO    ✓ done#4 prompt=32843 cached=0(0%) out=1(reason=1 content=0) ttft=5.409s total=5.412s gen=N/A kv=548.2MiB status=length
00:05:54 INFO    {'request_id': '98e15ffe2ca2401294f5df4be57b737c'} savepoint resume: req=5 covered=32768 of prompt_len=32843 depth_from_newest=0 entries=1
00:05:54 INFO    ✓ done#5 prompt=32843 cached=32768(100%) out=64(reason=64 content=0) ttft=0.085s total=0.383s gen=214.2tok/s kv=548.2MiB status=length
00:05:54 INFO    {'request_id': 'e1905ee1388745b4b7cf770c0855b57c'} savepoint resume: req=6 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=1
00:05:55 INFO    ✓ done#6 prompt=33150 cached=32768(99%) out=64(reason=64 content=0) ttft=0.116s total=0.497s gen=168.3tok/s kv=552.5MiB status=length
00:06:00 INFO    ✓ done#7 prompt=32843 cached=0(0%) out=1(reason=1 content=0) ttft=5.412s total=5.414s gen=N/A kv=548.2MiB status=length
00:06:00 INFO    {'request_id': 'ac2b16917b04403f97c185b0f2768ad2'} savepoint resume: req=8 covered=32768 of prompt_len=32843 depth_from_newest=0 entries=1
00:06:01 INFO    ✓ done#8 prompt=32843 cached=32768(100%) out=64(reason=64 content=0) ttft=0.088s total=0.546s gen=139.7tok/s kv=548.2MiB status=length
00:06:01 INFO    {'request_id': '3d340f62e4ea4b67adc33c73f312f116'} savepoint resume: req=9 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=1
00:06:01 INFO    ✓ done#9 prompt=33150 cached=32768(99%) out=64(reason=64 content=0) ttft=0.116s total=0.442s gen=195.9tok/s kv=552.5MiB status=length
00:06:07 INFO    ✓ done#10 prompt=32843 cached=0(0%) out=1(reason=1 content=0) ttft=5.422s total=5.426s gen=N/A kv=548.2MiB status=length
00:06:07 INFO    {'request_id': '0e6fdd73697c4fadb0bc669a34120dfe'} savepoint resume: req=11 covered=32768 of prompt_len=32843 depth_from_newest=0 entries=1
00:06:07 INFO    ✓ done#11 prompt=32843 cached=32768(100%) out=64(reason=64 content=0) ttft=0.090s total=0.549s gen=139.5tok/s kv=548.2MiB status=length
00:06:07 INFO    {'request_id': '5ab4dfda536542b193b0405a6d8c72ee'} savepoint resume: req=12 covered=32768 of prompt_len=33150 depth_from_newest=0 entries=1
00:06:08 INFO    ✓ done#12 prompt=33150 cached=32768(99%) out=64(reason=64 content=0) ttft=0.116s total=0.497s gen=168.0tok/s kv=552.5MiB status=length
