Reliable Scale-Free Bandits via Empirical Likelihood
stat.ML, cs.LG
Submitted: 2026-10-13
Updated: 2026-10-13
License: http://creativecommons.org/licenses/by/4.0/
The gist: We study stochastic bandits without knowledge of reward scales or tail parameters.
Abstract
We study stochastic bandits without knowledge of reward scales or tail parameters. Almost-sure regret guarantees describe eventual learning but do not quantify expected performance or the risk of large regret in a finite run. We introduce EL-F, an anytime empirical-likelihood (EL) extension of the g-Forcing policy of Cowan and Katehakis (2020), and characterize its performance at three levels. First, for integrable rewards and non-decreasing, diverging exploration schedules g with vanishing increments, EL-F preserves the g-Forcing asymptotics for pseudo-regret R(T): R(T)/g(T) to sum i:Δ i>0Δ i almost surely as T to infinity, where Δ i is the suboptimality gap of arm i. Second, on every sub-exponential instance, for non-decreasing g(t)=ω(t) satisfying a mild feasibility condition, expected pseudo-regret is at most g(T) sum i:Δ i>0Δ i+C, where C is an instance-dependent constant independent of T. Moreover, we also establish finite-time tail bounds with super-polynomial decay in regret beyond the forced-exploration budget. For slowly varying g, we determine the exact exponent of linear regret deviations on two-armed Gaussian instances with common variance and establish a matching lower bound among policies satisfying the same expected-regret budget on every such Gaussian instance. These quantitative guarantees also cover the greedy variant obtained at zero EL radius. A fixed positive radius introduces local optimism while preserving the leading asymptotic regret. We establish coupled pathwise dominance over the greedy variant in two-armed bandits with a deterministic suboptimal arm. Experiments demonstrate reductions in prolonged suboptimal allocation compared with g-Forcing on challenging instances.
Sources
- An Asymptotically Optimal Policy for Uniform Bandits of Unknown Support
- Parameter-Free Heavy-Tailed Bandits
- Regret Distribution in Stochastic Bandits: Optimal Trade-off between Expectation and Tail Risk
- Data-Driven Upper Confidence Bounds with Near-Optimal Regret for Heavy-Tailed Bandits
Related papers
- Behavior of prediction performance metrics with rare events
- Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEs
- A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
- Efficient quadratic entropy with distance sketches
- Embedding-Bias in Conditional Independence Testing
- From Log-Odds to Shapley Values: An Explanatory Geometry for the Weighted Naive Bayes Classifier