feat: multi-provider failover support#929

Open

TroyMitchell911 wants to merge 19 commits into

katanemo:mainfrom

TroyMitchell911:feat/multi-provider-failover

Commits on Apr 28, 2026

common: add proptest dev-dependency for configuration tests
TroyMitchell911
committed
common: add RetryPolicy configuration types
TroyMitchell911
committed
common: add RetryPolicy proptest and YAML pattern tests
TroyMitchell911
committed
config: add retry_policy to plano_config_schema.yaml
TroyMitchell911
committed
common: add sha2, dashmap, tokio runtime dependencies for retry module
TroyMitchell911
committed
retry: add core retry types and module structure
TroyMitchell911
committed
retry: add backoff calculator with jitter strategies
TroyMitchell911
committed
retry: add error detector for HTTP response classification
TroyMitchell911
committed
retry: add error response builder for retry exhaustion
TroyMitchell911
committed
retry: add state managers for latency blocking and retry-after
TroyMitchell911
committed
retry: add configuration validation for retry policies
TroyMitchell911
committed
retry: add provider selector with failover logic
TroyMitchell911
committed
retry: add retry orchestrator coordinating all components
TroyMitchell911
committed
retry: update Cargo.lock for retry module dependencies
TroyMitchell911
committed
feat: preserve original JSON bytes for prompt cache compatibility
TroyMitchell911
committed
feat: integrate retry orchestrator into LLM handler
TroyMitchell911
committed
config_generator: allow multiple providers for the same model
TroyMitchell911
committed
llm handler: capture request_path for failover forwarding
TroyMitchell911
committed
add example plano_config.yaml with retry/failover settings
TroyMitchell911
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: multi-provider failover support#929

feat: multi-provider failover support#929
TroyMitchell911 wants to merge 19 commits into
katanemo:mainfrom
TroyMitchell911:feat/multi-provider-failover

Commits on Apr 28, 2026

common: add proptest dev-dependency for configuration tests

common: add RetryPolicy configuration types

common: add RetryPolicy proptest and YAML pattern tests

config: add retry_policy to plano_config_schema.yaml

common: add sha2, dashmap, tokio runtime dependencies for retry module

retry: add core retry types and module structure

retry: add backoff calculator with jitter strategies

retry: add error detector for HTTP response classification

retry: add error response builder for retry exhaustion

retry: add state managers for latency blocking and retry-after

retry: add configuration validation for retry policies

retry: add provider selector with failover logic

retry: add retry orchestrator coordinating all components

retry: update Cargo.lock for retry module dependencies

feat: preserve original JSON bytes for prompt cache compatibility

feat: integrate retry orchestrator into LLM handler

config_generator: allow multiple providers for the same model

llm handler: capture request_path for failover forwarding

add example plano_config.yaml with retry/failover settings