Template library · 20 suites

20 prompt-eval templates with ready-made tests

On this page

The short answer

  • 20 templates, each with ready-made cases and a one-click Litmiq link. Eleven were already published; nine are new as of 19 Nov 2026.
  • Every suite is illustrative: fictional brands and made-up facts, no model outputs or scores.
  • The earlier prompt eval templates list and the original templates page stay published.

Templates

How they work

Each template page lists the system prompt, the scoring criteria and the cases. The Run in Litmiq button opens /app?suite=/assets/suites/….json. The app fetches that file from this site, shows a preview, and loads it only after you confirm. Your API key stays in your browser and is sent only to the provider you choose.

Suites are licensed CC BY 4.0. Credit Litmiq and link back to the template page.

FAQ

Are these official vendor templates?

No. They are illustrative Litmiq suites with fictional products and made-up facts. They are free to adapt under CC BY 4.0, with credit. No scores are included.

How is this different from /prompt-eval-templates?

The earlier library has 11 use-case pages. This library lists all 20: those 11, plus 9 new suites published on 19 Nov 2026. Both libraries stay up.

Do the tests include model outputs?

No. Each suite has a system prompt, scoring criteria and expected behavior for every case. You supply your own API key in the Litmiq app to produce outputs.

Can I use these in CI?

You can export a Promptfoo YAML from the app after you load a suite. A full Litmiq CLI is a separate product stream and is not claimed on this page.

Check a prompt first

If you are not ready for a full suite, paste a system prompt into the no-signup checker.

  • Free, no signup
  • Runs in your browser
  • Your OpenAI key, sent only to OpenAI