Batched Cascading Bandits
Abstract
Cascading bandits model ordered recommendation under stochastic prefix feedback: in each round, a learner selects and orders out of items but observes outcomes only up to the first click. Standard cascading bandit algorithms update after every round, which can be impractical in real-world scenarios where instant feedback is not always available. We study batched cascading bandits, where the learner commits all recommendation lists in a batch using the feedback available at its start and updates the policy only at its batch endpoint. To address different batch constraints, we propose two algorithms: Batched Cascade Successive Accepts and Rejects (BC-SAR) and Batched Cascade Upper Confidence Bound (BC-UCB). Both algorithms combine first-position rotation with mechanisms tailored to their respective batch constraints. On homogeneous-gap instances with common attraction-probability gap and constant algorithm parameters, BC-SAR has expected regret using batches. BC-UCB has expected regret using batches. Numerical experiments evaluate our algorithms and examine their empirical performance under batched feedback.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.