Evidence of testing, not a certification
Compliance evidence pack
On this page
The short answer
- After any run in the app, download a timestamped SHA-256 hashed JSON record, or print / save a PDF.
- The pack is evidence that you ran these tests, with these cases, models, and scores, at the timestamp in the file.
- It is not a certification, not a legal determination, and not SOC 2, ISO 42001, HIPAA, GDPR, or an audit opinion. Litmiq does not store the pack.
What the pack is
The compliance evidence pack is a file you produce in the Litmiq browser app after a test run. It holds a timestamp, the models and judge you used, the system prompt and scoring criteria (with API keys removed), the cases, the outputs, the scores and reasons, and a SHA-256 hash of that canonical record. You can download the hashed JSON or print / save a PDF from the same record.
Keep the file with your own records, attach it to a change ticket, or hand it to a reviewer. The hash lets you show that the record has not been silently edited after you downloaded it, provided you hash the record object and compare it with the sha256 field.
What it is not
The pack is evidence of testing, not a certification. Litmiq is not a certifying body. Exporting a pack does not mean your system is compliant with any law or standard. It is not SOC 2, ISO 42001, ISO 27001, HIPAA, GDPR, or EU AI Act compliance, and it is not a legal opinion, penetration test, or third-party audit.
We will not describe this file as a certificate, a seal, or a substitute for the programs those names refer to. If a reviewer asks for evidence that you tested a prompt or a model change, this is that evidence — nothing more.
How it works
Run your cases in the Litmiq app with your own API keys. After the run, open Compliance evidence pack, optionally add notes (the notes are included in the hash), then download the hashed JSON or print / save a PDF. The hash is computed in this browser. Litmiq does not receive your keys, does not store the pack, and does not host an approval workflow.
For an A-to-B model move, you can still use Migration sign-off in the same results panel: that report compares two models and can record a local reviewer approval in the downloaded file. For release checks in CI, use the open-source Action litmiq/litmiq-ci. A missed threshold fails the job; a required GitHub check will block the merge.
What is in the pack
Each file is a wrapper: kind, version, sha256, and record. The record includes a creation timestamp, the run timestamp, the judge model, the (scrubbed) system prompt, scoring criteria, optional notes, a pass threshold of 7.0, per-model averages and pass rates, and each case with inputs, expected behavior, outputs, scores, and reasons.
The SHA-256 is taken over JSON.stringify(record) in the browser. Provider keys matching common patterns, and any key the app currently holds, are replaced with [key removed] before the hash. You should still review the file before you share it: prompts can contain other secrets.
FAQ
Is this a certification?
No. The pack is a record of tests you ran in the Litmiq browser app. Litmiq is not a certifying body, and the file is not a certificate, attestation, or audit opinion.
Does this make us SOC 2, ISO 42001, HIPAA, or GDPR compliant?
No. Those are organizational programs and legal questions. The pack only shows which cases you ran, which models you used, and how they were scored, at the timestamp in the file.
Does Litmiq store the pack or host an approval?
No. The SHA-256 hash is computed in your browser. The JSON and the printable copy live only in the files you download or print. Litmiq does not receive the pack.
How is this different from a migration sign-off report?
Sign-off compares two models from a run and can record a local reviewer approval in that file. The evidence pack covers any run — one model or several — as a timestamped hashed record. You can use both.
Can I verify the hash?
Yes. SHA-256 the canonical JSON of the record object (JSON.stringify of the record, not the wrapper). It should match the sha256 field on the wrapper and the hash printed on the PDF.
Open the app
Run your cases, then download a hashed evidence pack. Litmiq does not store it.
- Free, no signup
- Runs in your browser
- Your OpenAI key, sent only to OpenAI