Glossary
Deterministic check (assertion)
On this page
The short answer
- A deterministic check is a rule code can verify the same way every time, such as “the output parses as JSON” or “the reply is under 80 words.” Use code checks for anything exact, and judges only for judgment calls. The JSON extraction guide includes an offline checker script.
- This is a glossary entry, not a product claim or a benchmark result.
- All terms · Templates · Guides.
Definition
A deterministic check is a rule code can verify the same way every time, such as “the output parses as JSON” or “the reply is under 80 words.” Use code checks for anything exact, and judges only for judgment calls. The JSON extraction guide includes an offline checker script.
In practice
Canary strings, exact labels and schema validation are deterministic. Tone is not. The JSON schema validator runs those checks in your browser.
Related terms
FAQ
Does Litmiq implement “Deterministic check (assertion)” as a built-in metric?
Only where the definition itself says so. Many terms are industry vocabulary. Litmiq is a single-turn, BYOK prompt tester with an LLM judge, not a full evaluation platform.
Where is the rest of the glossary?
The hub at /glossary lists every term. This page is the standalone entry for Deterministic check (assertion).
See the term in a suite
Many glossary entries have a matching template you can run in the browser.
- Free, no signup
- Runs in your browser
- Your OpenAI key, sent only to OpenAI