mesh-deck
A control deck for running many AI models on shared GPUs without out-of-memory crashes.
$ mesh status
ServiceStatePIDPort
llm ● running 41218001
stt ● running 41888004
tts ◐ starting 42608005
embed○ pending- 8003
plan first · start in order · press q to quit
$ pipx install mesh-deck
Open source · MIT · github.com/mrahmedromman/mesh-deck