Problem
SDK PR validation runs the full test suite on every PR regardless of what changed. A single PR run consumes on the order of 2,000 minutes of Helix compute across all platforms. This contributes to slow PR turnaround times and puts pressure on shared Helix agent availability.
Goal
Implement a framework for conditionally running tests based on what source files changed in a PR. The target is to have at least one-third to one-half of total PR test time covered by conditional scopes, so that the typical PR touching a single area sees a meaningful reduction in validation time.
All tests continue to run unconditionally on CI builds (main, release branches).
Design
See the design document and draft PR #55166 for the proposed approach.
Problem
SDK PR validation runs the full test suite on every PR regardless of what changed. A single PR run consumes on the order of 2,000 minutes of Helix compute across all platforms. This contributes to slow PR turnaround times and puts pressure on shared Helix agent availability.
Goal
Implement a framework for conditionally running tests based on what source files changed in a PR. The target is to have at least one-third to one-half of total PR test time covered by conditional scopes, so that the typical PR touching a single area sees a meaningful reduction in validation time.
All tests continue to run unconditionally on CI builds (
main, release branches).Design
See the design document and draft PR #55166 for the proposed approach.