Models, providers and routing
Model discovery and live health
Janus finds each provider's models and shows Healthy, Degraded or Down based on probes and real traffic.
What it is
Janus probes each upstream on a schedule, discovers its models with context windows and, where published, prices. Model cards carry a Healthy, Degraded or Down badge based on the probe and real traffic.
Why you want it
Users can see a model is down before they file a ticket, and admins see an outage within minutes.
The models each person may use, with health, speed, price, context window and recent activity.
Actual Janus interface · Demo identities and synthetic usageHow it works
- Default discovery interval 2 minutes, adjustable at runtime from 1 minute to 7 days
- Context windows read from vLLM max_model_len, llama.cpp n_ctx and Ollama /api/show
- Down when the upstream is unreachable or all recent requests failed; Degraded at 10% or more errors over 10 minutes
- Policy rejections such as quota or grant refusals are excluded from error rates
In the product
Screenshot above. Actual Janus interface with demo identities and synthetic usage.
See it on your own network.
The Community edition is free for up to 25 people. The 30-day Business trial unlocks every Business feature.