Does LinUCB Need Valid Confidence Sets?
Abstract
We show that replacing LinUCB's usual confidence width by any fixed preserves sublinear regret when the action set is -smooth and -strongly convex. Our high-probability regret bound for this generalisation, -LinUCB, establishes that valid confidence sets are not necessary for the success of LinUCB. We identify the mechanism behind this result: action-set curvature drives -LinUCB to explore every direction, even when optimism is not guaranteed. To analyse this mechanism, we introduce a logarithmically capped spectral potential that, unlike the standard log-determinant potential, caps contributions from well-explored directions. This yields lower bounds on the smallest eigenvalue of the design matrix. At the standard confidence width , our -round regret bound in dimensions is , up to iterated-logarithmic factors, improving the horizon dependence of the classical LinUCB guarantee by a factor of .
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.