Commit 3615014
committed
feat(catalog): add security-evaluations.ndjson to demo perf data tarball
Add sample security evaluation data for three of the four certified demo
models, to be consumed by the upcoming security-metrics loader.
- certified/production-llm-8b: 2 records (pipeline + standalone scans, both passing)
- certified/compliance-assistant-3b: 2 records (pipeline + domain-specific scans, both passing)
- certified/analytics-forecaster-5b: 1 record (pipeline scan, failing — attack_success_rate: 0.65)
- certified/secure-embeddings-v2: no file (embeddings models are not garak targets)
The intentional absence for secure-embeddings-v2 exercises the loader's
"skip silently when security-evaluations.ndjson is absent" behavior.
Assisted-by: Claude Opus 4.6
Signed-off-by: Paul Boyd <paul@pboyd.io>1 parent 3e8c430 commit 3615014
1 file changed
Binary file not shown.
0 commit comments