- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
AfterImage introduces CORA, a small action-query adapter guided by object-region annotations during training. A log-sum-exp correction preserves each intervened row's total visual attention while redistributing it across image tokens, and the region loss is isolated from backbone gradients. Experiments on π0 and π0.5 show gains on LIBERO-Plus and mixed results on LIBERO-PRO, alongside attention measurements and frozen-policy RoPE interventions.
Critical strengths
-
The distinction between visual attention mass and within-image allocation is useful. The normalization has a clear, exact local guarantee, making the intended intervention easy to understand.
-
Deployment is lightweight: the adapter adds 294,912 parameters and requires no object masks or external perception model at inference. This makes the training-time supervision practical to use.
-
The transfer evaluation is substantial and uses matched initial states and action noise. Appendix E also reports paired significance tests, and the paper openly discusses the positional-generalization trade-off.
Critical weaknesses
-
The experiments compare CORA with Stock, but not with GuidedVLA or a comparable mask-supervised adapter. There are also no training ablations removing budget conservation or gradient isolation. This leaves the benefit of the proposed mechanisms over object supervision itself unresolved.
-
The causal and frequency-specific claims exceed the evidence. Higher target attention does not establish why control improves, and removing RoPE from a frozen model does not show that learned low-frequency adapters outperform high-frequency or unrestricted ones (Sections 5.4–5.5).
-
The improvement is less consistent on the stronger backbone: π0.5 gains 1.76 points on LIBERO-Plus but loses 0.51 overall on LIBERO-PRO, including 3.50 points on Position. This limits the claim of broadly improved robustness.
Questions for authors
-
How does CORA compare with GuidedVLA or an otherwise matched mask-supervised adapter, including variants without the LSE correction and gradient isolation?
-
With parameter count and supervision fixed, do learned low-frequency adapters outperform high-frequency and full-band adapters? What controlled evidence supports the causal routing claim?
-
Are the π0.5 gains and Position/Task regressions stable across independent fine-tuning seeds? How should these trade-offs affect the scope of the robustness claim?