01:20:16 INFO    serving floor: driver serving-growth row = 8 MiB [MEASURED_CACHED] — physical the driver takes after the freeze (cubins on first dispatch, kernel-stack re-grow, post-boot graph exec), reported by driver.modules_serving and reserved here. Recorded at this configuration by a prior serving process.
01:20:24 INFO    engine ready, accepting requests on 0.0.0.0:8000
01:20:35 INFO    ✓ done#1 prompt=33060 cached=0(0%) out=1(reason=1 content=0) ttft=5.664s total=5.671s gen=N/A kv=552.5MiB status=length
01:20:45 INFO    ✓ done#2 prompt=33041 cached=0(0%) out=568(reason=386 content=182) ttft=5.704s total=10.248s gen=125.0tok/s kv=561.0MiB status=stop
01:20:55 INFO    ✓ done#3 prompt=33052 cached=32768(99%) out=1462(reason=1312 content=150) ttft=0.137s total=10.253s gen=144.5tok/s kv=573.8MiB status=stop
01:21:01 INFO    ✓ done#4 prompt=33060 cached=0(0%) out=1(reason=1 content=0) ttft=5.688s total=5.692s gen=N/A kv=552.5MiB status=length
01:21:12 INFO    ✓ done#5 prompt=33041 cached=32768(99%) out=1382(reason=1223 content=159) ttft=0.111s total=10.944s gen=127.6tok/s kv=573.8MiB status=stop
01:21:20 INFO    ✓ done#6 prompt=33052 cached=32768(99%) out=1128(reason=957 content=171) ttft=0.113s total=8.200s gen=139.5tok/s kv=569.5MiB status=stop
01:21:26 INFO    ✓ done#7 prompt=33060 cached=0(0%) out=1(reason=1 content=0) ttft=5.697s total=5.701s gen=N/A kv=552.5MiB status=length
01:21:32 INFO    ✓ done#8 prompt=33041 cached=32768(99%) out=793(reason=625 content=168) ttft=0.117s total=6.399s gen=126.2tok/s kv=565.2MiB status=stop
01:21:39 INFO    ✓ done#9 prompt=33052 cached=32768(99%) out=942(reason=721 content=221) ttft=0.115s total=6.730s gen=142.4tok/s kv=565.2MiB status=stop
01:21:45 INFO    ✓ done#10 prompt=33060 cached=0(0%) out=1(reason=1 content=0) ttft=5.731s total=5.735s gen=N/A kv=552.5MiB status=length
01:21:53 INFO    ✓ done#11 prompt=33041 cached=32768(99%) out=1172(reason=1052 content=120) ttft=0.148s total=8.140s gen=146.6tok/s kv=569.5MiB status=stop
01:22:08 INFO    ✓ done#12 prompt=33052 cached=32768(99%) out=2048(reason=2048 content=0) ttft=0.116s total=14.701s gen=140.4tok/s kv=586.5MiB status=length
01:22:13 INFO    ✓ done#13 prompt=33060 cached=0(0%) out=1(reason=1 content=0) ttft=5.695s total=5.698s gen=N/A kv=552.5MiB status=length
01:22:21 INFO    ✓ done#14 prompt=33041 cached=32768(99%) out=1044(reason=884 content=160) ttft=0.115s total=7.404s gen=143.2tok/s kv=569.5MiB status=stop
01:22:26 INFO    ✓ done#15 prompt=33052 cached=32768(99%) out=764(reason=640 content=124) ttft=0.142s total=5.464s gen=143.5tok/s kv=565.2MiB status=stop
01:22:32 INFO    ✓ done#16 prompt=33060 cached=0(0%) out=1(reason=1 content=0) ttft=5.700s total=5.703s gen=N/A kv=552.5MiB status=length
01:22:41 INFO    ✓ done#17 prompt=33041 cached=32768(99%) out=1383(reason=1225 content=158) ttft=0.108s total=9.374s gen=149.3tok/s kv=573.8MiB status=stop
01:22:50 INFO    ✓ done#18 prompt=33052 cached=32768(99%) out=1044(reason=843 content=201) ttft=0.117s total=8.103s gen=130.7tok/s kv=569.5MiB status=stop
01:22:55 INFO    ✓ done#19 prompt=33060 cached=0(0%) out=1(reason=1 content=0) ttft=5.705s total=5.709s gen=N/A kv=552.5MiB status=length
01:23:07 INFO    ✓ done#20 prompt=33041 cached=32768(99%) out=1586(reason=1381 content=205) ttft=0.111s total=11.339s gen=141.2tok/s kv=578.0MiB status=stop
01:23:12 INFO    ✓ done#21 prompt=33052 cached=32768(99%) out=885(reason=714 content=171) ttft=0.113s total=5.633s gen=160.3tok/s kv=565.2MiB status=stop
01:23:18 INFO    ✓ done#22 prompt=33060 cached=0(0%) out=1(reason=1 content=0) ttft=5.702s total=5.706s gen=N/A kv=552.5MiB status=length
01:23:24 INFO    ✓ done#23 prompt=33041 cached=32768(99%) out=671(reason=472 content=199) ttft=0.108s total=5.475s gen=125.0tok/s kv=561.0MiB status=stop
01:23:35 INFO    ✓ done#24 prompt=33052 cached=32768(99%) out=1638(reason=1479 content=159) ttft=0.109s total=11.829s gen=139.8tok/s kv=578.0MiB status=stop
