Grade with a different provider than the models you test to reduce self-preference bias. The judge uses the key for its provider.
Litmiq is a free, no-signup browser app for prompt evaluation. Compare OpenAI and Anthropic models side by side, score outputs with an LLM judge, and share results as a link. Your API key stays in this browser; Litmiq has no eval backend.
Watch a real Litmiq run: one support-bot prompt, 8 test cases, 3 models, scored by an LLM judge. These are recorded outputs from Llama 3.3 70B, Gemma 4 26B, Llama 3.1 8B on Cloudflare Workers AI (13 Nov 2026), replayed in your browser, not generated live.
Suite: Compare OpenAI models on one prompt (Harbor Lane Books support, fictional) · recorded run (JSON)
Grade with a different provider than the models you test to reduce self-preference bias. The judge uses the key for its provider.