Template library

Prompt eval templates you can run in one click

On this page

The short answer

  • 11 use-case templates, each with eight illustrative cases and a one-click Litmiq link.
  • Every suite is fictional. There are no scores, ratings or usage claims.
  • Links use /app?suite= and a same-origin JSON file. The app previews the suite before loading it.
  • The earlier templates list, including benchmark suites, is still published.

Templates by use case

How they work

Each template is a Litmiq suite JSON: a system prompt, scoring criteria and cases with expected behavior. Opening the link does not call a model until you add a key and click Run. You can edit cases after they load and export them for CI.

Use these as starting points, then replace the fictional facts with your product’s. Add a case every time something fails in production.

FAQ

Are these official vendor templates?

No. They are illustrative Litmiq suites with fictional products. They are free to adapt under CC BY 4.0, with credit.

How does one-click run work?

Each page links to /app?suite=/assets/suites/….json. The app fetches that file from this site, shows a preview, and loads it only after you confirm.

What about the older templates page?

The original /templates list is still there, including benchmark and migration suites. This library is organised by use case, with a dedicated page for each.

Open a template

Start with the support-bot pack, or pick the use case that matches your prompt.

  • Free, no signup
  • Runs in your browser
  • Your OpenAI key, sent only to OpenAI

Follow Litmiq on LinkedIn