Glossary
Reference answer (golden answer)
On this page
The short answer
- A reference answer is a known-good output stored with a test case so new outputs can be compared to it. References suit tasks with one right answer, such as extraction or classification. For open-ended replies, expected behavior is usually more useful than a fixed reference text.
- This is a glossary entry, not a product claim or a benchmark result.
- All terms · Templates · Guides.
Definition
A reference answer is a known-good output stored with a test case so new outputs can be compared to it. References suit tasks with one right answer, such as extraction or classification. For open-ended replies, expected behavior is usually more useful than a fixed reference text.
In practice
If several phrasings are equally right, do not force a single golden sentence; use expected behavior or an allowed set of labels instead.
Related terms
FAQ
Does Litmiq implement “Reference answer (golden answer)” as a built-in metric?
Only where the definition itself says so. Many terms are industry vocabulary. Litmiq is a single-turn, BYOK prompt tester with an LLM judge, not a full evaluation platform.
Where is the rest of the glossary?
The hub at /glossary lists every term. This page is the standalone entry for Reference answer (golden answer).
See the term in a suite
Many glossary entries have a matching template you can run in the browser.
- Free, no signup
- Runs in your browser
- Your OpenAI key, sent only to OpenAI