Glossary
Expected behavior
On this page
The short answer
- Expected behavior is a short, checkable description of what the answer to a test case must do and must not do, rather than its exact wording. “Must say the 30-day window has passed; must not promise a refund” can be checked by a person or a judge; “a good answer” cannot.
- This is a glossary entry, not a product claim or a benchmark result.
- All terms · Templates · Guides.
Definition
Expected behavior is a short, checkable description of what the answer to a test case must do and must not do, rather than its exact wording. “Must say the 30-day window has passed; must not promise a refund” can be checked by a person or a judge; “a good answer” cannot.
In practice
Write the must and the must-not on the same case. The guide on writing expected behavior has examples.
Related terms
FAQ
Does Litmiq implement “Expected behavior” as a built-in metric?
Only where the definition itself says so. Many terms are industry vocabulary. Litmiq is a single-turn, BYOK prompt tester with an LLM judge, not a full evaluation platform.
Where is the rest of the glossary?
The hub at /glossary lists every term. This page is the standalone entry for Expected behavior.
See the term in a suite
Many glossary entries have a matching template you can run in the browser.
- Free, no signup
- Runs in your browser
- Your OpenAI key, sent only to OpenAI