- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper investigates how visual precision and capacity should be allocated according to action requirements in robot manipulation. The authors propose Action-Visual Precision Matching, which jointly selects locations and precision levels under a fixed budget and refines the base policy using visual feature residuals. Experiments on LIBERO demonstrate improvements over the base policy, particularly for ACT, and show that optimal visual configurations vary across tasks and execution states.
Critical strengths
- The paper presents an interesting perspective on adaptive visual perception by distinguishing visual relevance from action-dependent precision requirements.
- The proposed method provides a coherent framework for joint location-precision selection and residual-based action refinement.
Critical weaknesses
-
Insufficient Evidence for Action-Visual Precision Alignment. The central claim of the paper is that visual precision should be matched to action requirements. However, conditioning visual allocation on action representations does not guarantee that the selected precision levels reflect actual action demands. While Figure 2 shows that precision allocation varies across tasks and timesteps, the paper provides limited analysis of why these variations occur or how they relate to action sensitivity, task progress, or manipulation stages. As a result, it remains unclear whether the learned allocation genuinely captures action-visual precision matching or merely exploits task-specific heuristics to improve performance.
-
Limited Justification for Joint Location-Precision Selection. In Table 3, random allocation already yields a substantial improvement over the base policy (80.17% -> 81.77%), whereas learned allocation provides a relatively modest additional gain (82.82%). Also, the effects of location and precision selection are not disentangled. Ablating these components individually is necessary to justify the joint selection design and quantify each mechanism's contribution.
-
Inconsistent Gains Across Policy Architectures. Performance improvements are heavily concentrated in ACT (+2.65), whereas Diffusion Policy (+0.43) and (+0.12) exhibit only marginal gains. This discrepancy weakens the claim that the proposed method provides consistent benefits across diverse policy architectures.
-
Presentation. The paper uses terms such as "visual precision," "visual capacity," and "measurement sufficiency," but their distinctions from established concepts such as spatial resolution, patch scale, and token budget are not sufficiently clarified.
Questions for authors
-
How can the authors verify that the learned precision allocation genuinely reflects action requirements? Could the authors provide an analysis relating the allocation patterns in Figure 2 to action sensitivity, task progress, or manipulation stages?
-
What are the individual contributions of location and precision selection? Could the authors provide separate ablations under the same visual budget?
-
Why are the performance improvements substantially smaller for Diffusion Policy and π0 compared to ACT?