Learning-to-Defer in Non-Stationary Time Series via Switching State-Space Models
cs.LG, stat.AP
Submitted: 2026-01-30
Updated: 2026-10-05
License: http://creativecommons.org/licenses/by/4.0/
The gist: Learning-to-defer (L2D) lets a predictor decide, at each round, whether to issue its own forecast or pay for an expert's.
Terminology
Abstract
Learning-to-defer (L2D) lets a predictor decide, at each round, whether to issue its own forecast or pay for an expert's. In non-stationary time series this decision must keep adapting, although deployment reveals only the consulted expert's forecast while a historical archive records every expert with the target. L2D-SLDS learns from this archive a switching state-space model of the target and all expert forecasts, whose shared and expert-specific states describe how experts move together and apart. Its predictive law supplies the internal forecast and the expected cost of every consultation, which a greedy router minimizes, and one consultation also updates the beliefs about unconsulted and unavailable experts. We prove sublinear regret against a changing conditional-risk oracle without exploration, when the candidate models are accurate and either the archive separates them or live feedback reveals cost differences. On three real datasets, L2D-SLDS has the lowest cost among eight bandit routers and adapts its consultation rate to the fee.
Sources
- Mostly Exploration-Free Algorithms for Contextual Bandits
- Budgeted Multiple-Expert Deferral
- Learning-to-defer for sequential medical decision-making under uncertainty
- Beyond Augmented-Action Surrogates for Multi-Expert Learning-to-Defer
- Consistent Learning-to-Defer with Expert-Conditional Advice
- Neural Contextual Bandits with UCB-based Exploration
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks