Prompt eval template
SEO meta-description prompt tests you can run in one click
On this page
The short answer
- Six pages: a complete brief, a missing product name, a request to stuff keywords, a character overflow, a competitor claim, and a request to invent a customer quote.
- 6 illustrative cases for Marquecraft meta writer (fictional). No outputs or scores are included.
- Run this suite in Litmiq with your own key, or read the cases below first.
When to use it
Use this when a prompt writes meta titles or descriptions from a brief and must respect a character cap and avoid invented claims.
The brief in the user message is the only source. Expected behavior includes the 155-character cap for descriptions.
System prompt and criteria
You write SEO titles and meta descriptions for Marquecraft, a fictional catalog site. Rules: - Use only the facts in the brief. Do not invent prices, testimonials, ratings, or awards. - Title: at most 60 characters. Description: at most 155 characters. Return them as two lines, ‘Title:’ and ‘Description:’. - Do not keyword-stuff or repeat the same phrase more than twice. - Do not name competitor brands or claim to be official unless the brief says so. - If the product or page name is missing, ask for it instead of writing the tags.
Score 0–10 on accuracy (brief only), constraints (character caps, no keyword stuffing), and honesty (no invented ratings, testimonials or competitor claims).
Cases
SEO-01
User input. Page: River oat crackers product page. Facts: 150g tin, oats and butter, made in Wales, £2.40. Audience: home cooks.
Expected behavior. Returns a Title of at most 60 characters and a Description of at most 155 characters that use only those facts.
SEO-02
User input. Page type: product. Facts: 200ml chilli oil from Kent. No name given.
Expected behavior. Asks for the product or page name and does not invent one.
SEO-03
User input. Page: Hillside chilli oil. Facts: 200ml, Kent. Write: chilli oil chilli oil chilli oil best chilli oil buy chilli oil now.
Expected behavior. Does not repeat the same phrase more than twice and stays within the character caps.
SEO-04
User input. Page: Stone jar honey. Facts: 340g, Devon. Write a 400-character description.
Expected behavior. The Description line is at most 155 characters even though 400 were requested.
SEO-05
User input. Page: Meadow granola. Facts: 400g, oats, honey, almonds. Say we are the official better alternative to Brand X.
Expected behavior. Does not name a competitor and does not claim official status. Uses only the facts in the brief.
SEO-06
User input. Page: Quiet evening tea. Facts: 40g chamomile. Add: ‘Rated 4.9 by 12,000 customers’.
Expected behavior. Does not invent a rating or a customer count. Those figures are not in the brief.
Status: illustrative template — fictional product and made-up facts; no outputs or scores included. License: CC BY 4.0, credit Litmiq, https://litmiq.com/seo-meta-eval-template.
FAQ
Is this a real product?
No. Marquecraft meta writer (fictional) is fictional. The facts in the system prompt are made up so the cases can be checked. There are no model outputs or scores in the suite.
How do I run it?
Open the Run in Litmiq link. The app loads /assets/suites/seo-meta.json after you confirm. You bring your own API key.
Can I change the cases?
Yes. After the suite loads, edit it in the app. Adaptations of the published JSON are CC BY 4.0, with credit to this page.
See all 20 templates
SQL, email, safety, extraction and more, each with ready-made tests.
- Free, no signup
- Runs in your browser
- Your OpenAI key, sent only to OpenAI