-
Notifications
You must be signed in to change notification settings - Fork 92
Add TraceContract compatibility fixtures for schema 0.1, 0.2, and 1.0 #219
Copy link
Copy link
Open
Labels
area:coreCore runtime and contractsCore runtime and contractscommunity-ownedSuitable for community ownershipSuitable for community ownershipdifficulty:advancedAdvanced / high-context workAdvanced / high-context workfixturesCanonical fixtures and validationCanonical fixtures and validationpriority:p1High priorityHigh prioritystatus:readyReady for contributorsReady for contributorssupport:betaBeta support levelBeta support leveltestingTests and test infrastructureTests and test infrastructure
Milestone
Description
Metadata
Metadata
Assignees
Labels
area:coreCore runtime and contractsCore runtime and contractscommunity-ownedSuitable for community ownershipSuitable for community ownershipdifficulty:advancedAdvanced / high-context workAdvanced / high-context workfixturesCanonical fixtures and validationCanonical fixtures and validationpriority:p1High priorityHigh prioritystatus:readyReady for contributorsReady for contributorssupport:betaBeta support levelBeta support leveltestingTests and test infrastructureTests and test infrastructure
Contribution lane: testing / fixtures
Difficulty: advanced
Ownership: community-owned
Priority: p1
Milestone: Evidence v2 & CI
Labels:
testing,fixtures,area:core,community-owned,status:ready,difficulty:advanced,priority:p1,support:betaBaseline: agent-inspect@6.17.1 → 6.18.0 niche launch
Problem
TraceContract needs explicit compatibility fixtures across schema 0.1, 0.2, and 1.0, including nested LLM metadata regressions related to #200.
Why it matters
1.x compatibility and check/matchers must not silently break older traces during 6.18.
Proposed scope
metadata.model/ LLM field cases covering check --allowed-model cannot see the LLM model on v0.1 traces (resolves the step name instead) #200 regressions (even if check --allowed-model cannot see the LLM model on v0.1 traces (resolves the step name instead) #200 remains open until fix(checks): resolve LLM model, provider, finish reason from nested metadata #201 merges).Out of scope
Suggested files
Acceptance criteria
Validation commands
Privacy / network notes
Synthetic traces only.
Contributor instructions
Comment first. Coordinate with #200/#201 status.
Maintainer-review boundary
Do not rewrite #200; this issue absorbs regression fixture needs.