Everything below ships in the binary you download —
the free edition carries the full governance stack.
Routing & scale
Every model behind one door
OpenAI-compatible, Anthropic Messages, Gemini Interactions, OpenAI Responses,
Azure OpenAI, Vertex AI, Bedrock Converse, RunPod pods & serverless, and
embedded local GGUF inference. Alias chains route per task; hedges and fallbacks
ride along. Tier D replicas share state over Redis.
Governance
Proof, not promises
Role-based access (admin, read-only ops, key-manager), SSO/OIDC, SCIM
provisioning, team workspaces, per-team and per-session budgets, full key
lifecycle with revocation — and an append-only, hash-linked audit chain.
Cost control
Spend you can steer
A semantic cache where hits never bill. Monthly token budgets that stop
overruns cold. Per-request, per-team, per-backend cost accounting. Route
the cheap tasks to small or local models — flagship only when it matters.
Observability
See every request
OTLP tracing export, Prometheus metrics, per-request JSONL logs, and a live
admin console — health, performance, syslog, governance, and license in one pane.
The audit-chain widget renders tamper evidence visually.
Security posture
Inside your walls
Self-hosted — prompts never leave your perimeter. Closed distribution:
a machine-code binary, no source to fork or leak. Secrets resolve from
env, files, commands, or the console-managed store — never committed,
never logged.
Also at the desk
The small things that make it operations
MCP tool-call governance · one-click provider presets · model finder and
downloader · RunPod deploy wizard · hot-reloading config and licenses ·
tamper-evident revocation list · Windows & Linux · single-file install.