- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies online selection among heterogeneous vision-language models under a global budget, without target labels, calibration data, or a pre-deployment reference set. CARE standardizes the class logits of queried models on a per-sample basis and uses the resulting confidence as a label-free proxy reward. It learns an expert-selection policy using image features from a base model, a contextual bandit, and dynamic budget control. Experiments demonstrate competitive accuracy–cost trade-offs under the paper’s definition of additional routing cost and support the usefulness of standardization for selecting among heterogeneous models. The theoretical analysis concerns budget-constrained optimization of confidence-based proxy rewards.
Critical strengths
- The problem is practically relevant, and the design aligns with the deployment constraints. CARE jointly addresses the absence of label feedback, differences in expert output scales, and limited inference budgets by combining confidence processing, online utility learning, and budget control. It progressively learns an expert-selection policy without pre-deployment reference data, and the overall results demonstrate the practical potential of this approach.
- The role of standardization receives fairly direct experimental support. Standardization improves performance overall in both confidence-based selection with access to all experts and online CARE. Comparisons across confidence metrics further support the finding that cross-model scale mismatch affects selection quality. Experiments with mixed domains and different input orderings provide additional insight into the framework’s behavior.
Critical weaknesses
The incremental benefit of image-level context has not been sufficiently isolated. The paper motivates per-sample routing through experts’ complementary strengths across inputs. Expert-utilization patterns and mixed-domain experiments support adaptation across domains, but do not sufficiently distinguish gains from identifying the strongest experts for each domain from gains that additionally exploit expert complementarity across images within the same domain. Without a control that removes image features while retaining the same proxy reward, online learning framework, and budget mechanism, the added value of fine-grained contextual decisions remains unclear.
Questions for authors
- How do standardized rewards lead to useful expert preferences? Existing ablations already support the usefulness of standardization for expert selection. For binary classification, the authors explain that the nonzero regularization term preserves dependence on the original logit margin. Could existing reward and routing records further clarify how these differences guide expert selection during online learning? This question seeks to understand the source of the reported effects.
- To what extent do CARE’s gains depend on image context? Particularly within single-domain streams, does CARE retain a clear advantage over a non-contextual policy that learns only overall expert preferences, when the proxy reward, exploration rules, and budget control are held fixed? Can existing results or routing records further distinguish the contributions of cross-domain specialization and within-domain, per-sample complementarity?
I thank the authors for their responses and the additional control experiment. However, given the marginal and inconsistent gains from image context (as discussed above), I do not think the work is yet at the level required for ICLR. I therefore maintain my original score.