Litmiq prompt evaluator — compare OpenAI and Anthropic models side by side

Litmiq is a free, no-signup browser app for prompt evaluation. Compare OpenAI and Anthropic models side by side, score outputs with an LLM judge, and share results as a link. Your API key stays in this browser; Litmiq has no eval backend.

No API key yet? Watch a recorded 30-second demo run

Try it in 30 seconds, no key needed

Watch a real Litmiq run: one support-bot prompt, 8 test cases, 3 models, scored by an LLM judge. These are recorded outputs from Llama 3.3 70B, Gemma 4 26B, Llama 3.1 8B on Cloudflare Workers AI (13 Nov 2026), replayed in your browser, not generated live.

Suite: Compare OpenAI models on one prompt (Harbor Lane Books support, fictional) · recorded run (JSON)

Your turn: run this suite on GPT or Claude with your own key. Load this suite
Litmiq Pro200 saved suites, CI on a schedule and regression alerts, $19/month. This app stays free.
Models to Test

Grade with a different provider than the models you test to reduce self-preference bias. The judge uses the key for its provider.

Test Cases
No evals yet
Configure your system prompt, choose models, add test cases, and hit Run Evals. Results appear here with per-metric scores.