Server Settings
Applies to all providers unless overridden per-provider.
Providers
All
LLM
Embedding
Rerank
Model Routing
| Model | Type | Capabilities | Provider |
|---|
API Keys
Manage gateway API keys used to authenticate requests to /v1/* endpoints.
| Label | Created |
|---|
Throughput (req/s)
Latency (ms)
Per-Provider Breakdown
| Provider | Requests |
|---|
Profiling
OFF
Results are in-memory only and will be lost on restart. Download important results.
| Time | Model | Source → Target | Mode | Duration | Flamegraph |
|---|
No profiling results. Enable profiling and send requests.
Content Capture
OFF
Captures full request/response bodies in memory. Results are ephemeral and lost on restart.
| Time | Model | Source → Target | Mode | Status | Detail |
|---|
No captures. Enable capture and send requests.
Error Dumps
| Time | Model | Source → Target | Phase | Status | Error | Actions |
|---|
No error dumps recorded.
Page 1 / 1
| Time | Model | Source → Target | Mode | API Key | Client IP | Status | Duration |
|---|