acceptodds
Under review as a conference paper at ICLR 2027

Does LinUCB Need Valid Confidence Sets?

Abstract

We show that replacing LinUCB's usual confidence width by any fixed preserves sublinear regret when the action set is -smooth and -strongly convex. Our high-probability regret bound for this generalisation, -LinUCB, establishes that valid confidence sets are not necessary for the success of LinUCB. We identify the mechanism behind this result: action-set curvature drives -LinUCB to explore every direction, even when optimism is not guaranteed. To analyse this mechanism, we introduce a logarithmically capped spectral potential that, unlike the standard log-determinant potential, caps contributions from well-explored directions. This yields lower bounds on the smallest eigenvalue of the design matrix. At the standard confidence width , our -round regret bound in dimensions is , up to iterated-logarithmic factors, improving the horizon dependence of the classical LinUCB guarantee by a factor of .

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.