02:40:07 INFO    serving floor: driver serving-growth row = 26 MiB [MEASURED_CACHED] — physical the driver takes after the freeze (cubins on first dispatch, kernel-stack re-grow, post-boot graph exec), reported by driver.modules_serving and reserved here. Recorded at this configuration by a prior serving process.
02:40:14 INFO    engine ready, accepting requests on 0.0.0.0:8000
02:40:21 INFO    ✓ done#1 prompt=33060 cached=0(0%) out=1(reason=1 content=0) ttft=5.662s total=5.670s gen=N/A kv=552.5MiB status=length
02:40:32 INFO    ✓ done#2 prompt=33041 cached=0(0%) out=903(reason=779 content=124) ttft=5.673s total=11.870s gen=145.7tok/s kv=565.2MiB status=stop
02:40:39 INFO    ✓ done#3 prompt=33052 cached=32768(99%) out=943(reason=730 content=213) ttft=0.109s total=6.577s gen=145.8tok/s kv=565.2MiB status=stop
02:40:45 INFO    ✓ done#4 prompt=33060 cached=0(0%) out=1(reason=1 content=0) ttft=5.690s total=5.694s gen=N/A kv=552.5MiB status=length
02:40:50 INFO    ✓ done#5 prompt=33041 cached=32768(99%) out=816(reason=676 content=140) ttft=0.131s total=5.422s gen=154.2tok/s kv=565.2MiB status=stop
02:40:57 INFO    ✓ done#6 prompt=33052 cached=32768(99%) out=856(reason=727 content=129) ttft=0.107s total=6.382s gen=136.4tok/s kv=565.2MiB status=stop
02:41:02 INFO    ✓ done#7 prompt=33060 cached=0(0%) out=1(reason=1 content=0) ttft=5.682s total=5.685s gen=N/A kv=552.5MiB status=length
02:41:07 INFO    ✓ done#8 prompt=33041 cached=32768(99%) out=662(reason=546 content=116) ttft=0.108s total=5.126s gen=131.9tok/s kv=561.0MiB status=stop
02:41:22 INFO    ✓ done#9 prompt=33052 cached=32768(99%) out=2048(reason=1932 content=116) ttft=0.108s total=14.757s gen=139.8tok/s kv=586.5MiB status=length
02:41:28 INFO    ✓ done#10 prompt=33060 cached=0(0%) out=1(reason=1 content=0) ttft=5.687s total=5.690s gen=N/A kv=552.5MiB status=length
02:41:36 INFO    ✓ done#11 prompt=33041 cached=32768(99%) out=1157(reason=941 content=216) ttft=0.107s total=8.018s gen=146.3tok/s kv=569.5MiB status=stop
02:41:45 INFO    ✓ done#12 prompt=33052 cached=32768(99%) out=1140(reason=957 content=183) ttft=0.108s total=8.628s gen=133.8tok/s kv=569.5MiB status=stop
