- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes RECAP-VLA, a framework for reducing two-view VLA inputs from 512 to 256 visual tokens while preserving closed-loop control. Its compactor uses simulator metric depth and calibrated camera geometry to associate cross-view tokens into physical-evidence components. A protected global-context scaffold, a learned action-relevance predictor, and bounded residual aggregation then determine the compact representation.
Critical strengths
The paper includes useful component and recovery controls.
The large improvement from action-level recovery is an interesting empirical observation.
Critical weaknesses
The paper seems like an engineering trick paper, without many theoretical contribution,
The performance improvement is marginal. Reducing 512 tokens to 256 halves the downstream visual sequence, not the entire inference cost: the full visual encoder still runs at deployment. The median saving is approximately 8.092 ms, but mean latency improves by only 2.53%, while p95 latency and peak memory remain essentially unchanged. This benefit may still be useful, but a stage-level breakdown is needed to show the costs of visual encoding, geometry planning, compact policy inference, and action decoding, and whether depth acquisition, transfer, and synchronization are included in “end-to-end” timing.
The main paper does not clearly define which tokens Hard-256 retains, how its budget is allocated across the two views, or how its selection and positional conventions compare with the other variants. It also does not show the key comparison against a simple balanced two-view selector or a 2D importance-based selector equipped with the same CAPA procedure. If Hard-256 uses a particularly weak selection rule, its 45-point collapse cannot establish that reasonable visual-token compression generally causes a failure of comparable magnitude.
Questions for authors
Does CAP improve on fixed final-layer adaptation? Please explain the rule selecting blocks 30–31, provide the existing 96-state diagnostic, and compare a small number of nearby layer choices or random layer pairs while keeping q/v projections, rank, and training budget fixed.