- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper profiles action-to-visual attention sinks in pretrained WAMs. KeepSink preserves these positions during spatial token selection, while SinkAge combines sink protection, age weighting, and a bounded historical attention budget. The objective is to reduce active visual context without retraining the policy.
Critical strengths
-
The sink-removal experiment is informative. Removing the dominant sink reduces Fast-WAM success from 73% to 3%, while LingBot-VA shows a different sensitivity pattern. This provides useful evidence that compression behavior depends on the backbone.
-
The historical comparisons use a shared physical packing interface and include established cache-selection baselines. This is a reasonable foundation for comparing active attention budgets.
Critical weaknesses
-
The proposed selection rules do not demonstrate a convincing advantage over simpler alternatives. On LIBERO-Long, H2O achieves 98.2% success versus SinkAge’s 96.6% at the same reported KV reduction. Removing historical sink privileges barely changes performance, and random filling outperforms the default SinkAge configuration on Suite-10. These results weaken the justification for the method’s additional design choices.
-
The efficiency and writing claims need tighter alignment with the evidence. Stored caches remain unpruned, so active-KV reduction is not equivalent to actual cache-memory savings. The real-world study also has only ten trials per task. Particularly concerning is the description of 85%, 84%, and 66% success as “comparable”: this is defensive wording that downplays a 19-point drop from Full KV.
Questions for authors
-
Can SinkAge show a consistent advantage over H2O or a simple age-based allocator at matched budgets?
-
What are the actual GPU-memory and policy-inference latency savings, separately from episode wall time?
3 comments
Follow-up on KV Compression Baselines and GPU-Memory Efficiency
We sincerely appreciate your constructive feedback, which has been particularly helpful in clarifying the scope of our efficiency claims and the significance of historical visual-context redundancy.
In response, we have added simpler allocation baselines, provided physical KV-pruning results to verify actual GPU-memory savings, and explicitly acknowledged the limitations regarding inference latency and baseline superiority.
As the discussion period approaches its end, please let us know if any concerns remain. If our clarifications and additional evidence have addressed your main concerns, we would be grateful if you would consider reflecting this in your final rating.
Thank you again for your valuable feedback and consideration.
Follow-up: Probe-Free KV Compression Results
We conduct an additional experiment to validate the practical efficiency of historical KV compression.
Our probe-free SinkAge variant eliminates expensive online dependency probing while retaining structural sink protection and bounded KV allocation. It achieves 82% SR versus 83% for Full KV on RoboTwin Suite-10 (B=384), with 90.8% lower resident KV and 20.1% lower peak GPU memory. Policy latency decreases from 8.284 to 3.718 s/chunk (−55.1%), reaching Full-KV-comparable latency (3.752 s/chunk).
These results further demonstrate that competitive closed-loop performance and actual GPU-memory savings can be achieved without costly online dependency probing.
Response to Reviewer w8PP: Simple Allocation Baselines, Physical KV Savings, and Experimental Claim Clarification
We thank the reviewer for the constructive feedback. We address the concerns below.
W1 / Q1. SinkAge versus H2O and Simpler Allocation Strategies
W2. Efficiency Evidence and Accuracy of Experimental Claims
In summary, we provide (1) additional matched-budget comparisons with H2O, StreamingLLM, Random Fill, and Pure Age-only shows no substantial performance degradation, suggesting action-irrelevant redundancy as a key source of historical visual-context compressibility. and (2) physical KV pruning experiments, confirming actual GPU-memory savings while identifying online dependency probing as a remaining latency bottleneck. Together, these results strengthen our central findings: structural action-to-visual sinks exhibit backbone-dependent functional importance, and pretrained WAMs can maintain competitive closed-loop performance under substantially reduced visual-KV budgets.