- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper addresses adaptation-induced prediction errors in mixed-shot recognition, where classes have heterogeneous numbers of labeled support examples. The authors propose SafeRoute, which preserves frozen-model predictions for unsupported classes through deterministic routing, and Local Evidence Control (LEC), which dynamically adjusts the interpolation between frozen and adapted scores using query-local evidence. The paper provides theoretical guarantees and evaluates the method across multiple datasets, vision-language encoders, and support profiles.
Critical strengths
S1. The paper addresses a meaningful problem by formalizing a prediction-retention constraint in mixed-shot recognition and providing explicit theoretical guarantees.
S2. The experimental design is well controlled. Comparisons with matched scalar and same-loss constant baselines help isolate the contribution of query-dependent control, with consistent improvements across datasets and encoders.
Critical weaknesses
W1. The contribution of the six handcrafted features in LEC is not sufficiently analyzed. Although the paper compares against fixed and count-based controls, it remains unclear whether the full feature design is necessary.
W2. Cross-parent validation remains limited. The main experiments primarily rely on TaskRes, while the additional parent-family evaluation is restricted to a single natural-history setting without detailed per-parent results.
Questions for authors
Q1. Could the authors provide feature ablations for LEC and compare it with a simpler confidence- or margin-based dynamic gating baseline under the same retention constraint?
Q2. Could the authors provide more detailed results for each parent adapter? Since the main experiments primarily rely on TaskRes, a more comprehensive cross-parent evaluation would help clarify the generalizability of SafeRoute-LEC across different adaptation methods.