Models, providers and routing
Protocol translation
Claude and Bedrock models are served through the OpenAI API, including tools, caching and streaming.
What it is
Anthropic, Bedrock and Vertex models are served through the OpenAI chat API. Janus translates tools, tool choice, images, system prompts and response format on the way in and streams on the way out.
Why you want it
Clients written for OpenAI can use Claude or Bedrock models without a second SDK or code path.
How it works
- Anthropic Messages and Bedrock Converse, including the binary converse-stream framing
- Tool calls, prompt caching and streaming preserved
- Metering always reads the provider's native response
- Display names are rewritten to the native model name before forwarding
See it on your own network.
The Community edition is free for up to 25 people. The 30-day Business trial unlocks every Business feature.