- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper distinguishes decision-level view interaction from excess interaction induced by a policy. It proposes selective substitutability training and a sketch-conditioned scheduler for acquiring camera frames under a communication budget, with evaluations in simulated manipulation and physical-robot settings.
Critical strengths
Distinguishing decision-level interaction from policy-induced excess interaction is an interesting conceptual contribution. It provides a useful way to examine whether additional observations address task ambiguity or limitations of the consuming policy.
The experiments report a positive paired success difference at intermediate budgets, separate policy and router effects, and account for sketch costs. Explicit reporting of unfavorable budget and transfer conditions makes the empirical scope credible.
Critical weaknesses
The added value of the central excess-interaction penalty remains unclear. Equations (7)–(8) combine control, subset-regret, excess-interaction, and calibration losses. Figure 6c studies several components, but does not show a matched () condition retaining the other losses. Consequently, the overall improvement supports the combined training framework more directly than the specific contribution of the proposed penalty.
The mechanism-level evidence is less conclusive than the closed-loop evidence. Section 5.2 reports excess decreasing from 0.01049 to 0.00940 and subset regret from 0.11757 to 0.11150 relative to all-subset training, while Figures 3–4 provide no uncertainty estimates. Sections 3.2 and 4.2 also acknowledge approximation and shared-bias concerns in the decision references. The reliability of these mechanistic differences therefore requires further characterization.
Questions for authors
- What happens when () while the other losses, training budget, and router remain unchanged? Does the excess-interaction penalty provide an additional closed-loop success benefit?
- Are the reported excess and subset-regret reductions consistent across training seeds? Please provide or identify paired uncertainty estimates for these differences.
- What empirical evidence shows that the excess reduction and the benefit of the penalty remain stable across reference choices or on cases where the approximate references disagree?
I would raise my rating if a matched ablation and reference-sensitivity analysis establish the added value of the excess-interaction penalty, and lower it if new evidence substantially weakens its claimed role in the reported improvements.