ovtool webui

no model idle

Settings

Language
Theme
Extra model paths
Download model (Hugging Face)
Chat
Knowledge
Image
Devices
Knowledge bases
+ New knowledge base
embedding model
chunk size
overlap

in characters; a knowledge base keeps the embedding model it was created with

Retrieval
embedding device
reranker
reranker device
candidates
passages
min score

vector search picks the candidates, the reranker re-scores them, and the top passages go to the model

Create a knowledge base on the left and add documents, then pick it in the Chat tab.
DeviceNameTypeDriverSubdevices