Glossary

Scoring criteria (rubric)

On this page

The short answer

  • Scoring criteria, or a rubric, are the written rules a judge or reviewer uses to decide how good an output is. Specific, anchored criteria (“10 = states the policy and offers a next step; 3 = invents a policy”) give more consistent scores than general ones (“be helpful”). In Litmiq, your criteria guide the judge while it reports four fixed scores.
  • This is a glossary entry, not a product claim or a benchmark result.
  • All terms · Templates · Guides.

Definition

Scoring criteria, or a rubric, are the written rules a judge or reviewer uses to decide how good an output is. Specific, anchored criteria (“10 = states the policy and offers a next step; 3 = invents a policy”) give more consistent scores than general ones (“be helpful”). In Litmiq, your criteria guide the judge while it reports four fixed scores.

In practice

Put the failure you care about in the anchors. If invented refunds are the risk, say so at score 3, not only “be accurate.”

FAQ

Does Litmiq implement “Scoring criteria (rubric)” as a built-in metric?

Only where the definition itself says so. Many terms are industry vocabulary. Litmiq is a single-turn, BYOK prompt tester with an LLM judge, not a full evaluation platform.

Where is the rest of the glossary?

The hub at /glossary lists every term. This page is the standalone entry for Scoring criteria (rubric).

See the term in a suite

Many glossary entries have a matching template you can run in the browser.

  • Free, no signup
  • Runs in your browser
  • Your OpenAI key, sent only to OpenAI

Follow Litmiq on LinkedIn