nonparametric statistics

Exploration in Bandit Algorithms
We propose a new bootstrap-based online algorithm for stochastic linear bandit problems. The key idea is to adopt residual bootstrap exploration, in which the agent estimates the next step reward by re-sampling the residuals of mean reward estimate.
Exploration in Bandit Algorithms
Residual Bootstrap Exploration for Stochastic Linear Bandit