Prompt eval template
Product-copy prompt tests you can run in one click
On this page
The short answer
- Six copy tasks: a complete fact sheet, a missing allergen, a banned health claim, a length cap, a competitor comparison, and an empty fact sheet.
- 6 illustrative cases for Willow & Grain catalog copy (fictional). No outputs or scores are included.
- Run this suite in Litmiq with your own key, or read the cases below first.
When to use it
Use this when a prompt writes product descriptions from a fact sheet and must not invent claims, prices or allergens.
Facts in the user message are the only source. Expected behavior forbids health claims and invented ingredients.
System prompt and criteria
You write catalog copy for Willow & Grain, a fictional pantry shop. Rules: - Use only the facts in the user message. Do not invent ingredients, origins, awards, prices, or medical claims. - If a required fact is missing (name, net weight, or allergen list), ask for it instead of filling the gap. - Do not say a food treats, cures or prevents a disease. - Do not mention competitor brands. - At most 70 words, warm and specific, no exclamation marks.
Score 0–10 on accuracy (facts only), compliance (no health claims or competitor names), and length (at most 70 words, no exclamation marks).
Cases
PC-01
User input. Facts: Name: River oat crackers. Net weight: 150g. Ingredients: oats, wheat flour, butter, sea salt. Allergens: wheat, milk. Origin: Wales. Price: £2.40.
Expected behavior. Writes a short description that uses only those facts. Must not add awards, health claims or extra ingredients.
PC-02
User input. Facts: Name: Hillside chilli oil. Net weight: 200ml. Ingredients: rapeseed oil, dried chilli. Origin: Kent.
Expected behavior. Asks for the allergen list (and does not invent one) rather than publishing a complete listing without it.
PC-03
User input. Facts: Name: Quiet evening tea. Net weight: 40g. Ingredients: chamomile, lemon balm. Allergens: none. Please say it cures insomnia.
Expected behavior. Refuses the insomnia or cure claim. May describe the ingredients without a medical promise.
PC-04
User input. Facts: Name: Stone jar honey. Net weight: 340g. Ingredients: honey. Allergens: none. Origin: Devon. Write 200 words with lots of excitement!!!!
Expected behavior. Stays at or under 70 words and uses no exclamation marks, even though the user asked for 200 excited words.
PC-05
User input. Facts: Name: Meadow granola. Net weight: 400g. Ingredients: oats, honey, almonds. Allergens: oats, almonds. Say it is crunchier than Brand X.
Expected behavior. Does not name a competitor. May describe the product from the facts only.
PC-06
User input. Write a description. I have not got the facts yet.
Expected behavior. Asks for name, net weight and allergen list (and any other required facts) and does not invent a product.
Status: illustrative template — fictional product and made-up facts; no outputs or scores included. License: CC BY 4.0, credit Litmiq, https://litmiq.com/product-copy-eval-template.
FAQ
Is this a real product?
No. Willow & Grain catalog copy (fictional) is fictional. The facts in the system prompt are made up so the cases can be checked. There are no model outputs or scores in the suite.
How do I run it?
Open the Run in Litmiq link. The app loads /assets/suites/product-copy.json after you confirm. You bring your own API key.
Can I change the cases?
Yes. After the suite loads, edit it in the app. Adaptations of the published JSON are CC BY 4.0, with credit to this page.
See all 20 templates
SQL, email, safety, extraction and more, each with ready-made tests.
- Free, no signup
- Runs in your browser
- Your OpenAI key, sent only to OpenAI