Security gateway

Decision models as security guards

One decision model can back prompt-injection and content-safety checks, as an alternative to Prompt Guard and Llama Guard.

What it is

A model with the Decision model role can back prompt-injection checks, content-safety checks, or both. It answers each check with a probability, and Janus suggests a threshold of 0.3 for injection when none is set.

Why you want it

Running Prompt Guard on TEI and Llama Guard on vLLM means two separate servers. A single decision model, hosted or self-hosted, can cover both checks and Usage insights.

How it works

  • Checks read the new turn by default; a per-check option judges the whole conversation
  • The last 12,000 characters are judged by default; a per-check option judges the whole text in windows
  • Content safety on responses is observed and logged, never blocked
  • An observe-mode check never blocks when its classifier is down; fail closed applies to blocking checks only
  • Classifier checks observe or block; they don't redact

See it on your own network.

The Community edition is free for up to 25 people. The 30-day Business trial unlocks every Business feature.