Glossary
Baseline
On this page
The short answer
- A baseline is a saved run of your test suite on the current prompt and model, used as the point of comparison for the next change. Without a baseline, you cannot say whether a score went down. In Litmiq, the JSON export of a run serves as a baseline.
- This is a glossary entry, not a product claim or a benchmark result.
- All terms · Templates · Guides.
Definition
A baseline is a saved run of your test suite on the current prompt and model, used as the point of comparison for the next change. Without a baseline, you cannot say whether a score went down. In Litmiq, the JSON export of a run serves as a baseline.
In practice
Re-run the same suite, same models, before you trust a small score change. Non-determinism makes one-off dips noisy.
Related terms
FAQ
Does Litmiq implement “Baseline” as a built-in metric?
Only where the definition itself says so. Many terms are industry vocabulary. Litmiq is a single-turn, BYOK prompt tester with an LLM judge, not a full evaluation platform.
Where is the rest of the glossary?
The hub at /glossary lists every term. This page is the standalone entry for Baseline.
See the term in a suite
Many glossary entries have a matching template you can run in the browser.
- Free, no signup
- Runs in your browser
- Your OpenAI key, sent only to OpenAI