- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes RCPE, a sequential controller for compressed-context inference. Starting from a compressed representation, it decides whether to answer, restore one or more context chunks, or abstain. It trains reliability and restoration-utility heads from counterfactual restorations, then selects a policy using simultaneous bounds on compression risk, absolute loss, and coverage.
Critical strengths
The policy-level formulation is well motivated. In particular, the paper recognizes that a useful restoration policy must account for repeated generation, context access, and the possibility that a restoration is harmful, rather than treating context expansion as free retrieval. The failure-stage analysis and the explicit cost accounting are also useful.
Critical weaknesses
The empirical evidence does not support the paper’s broad practical claims. In the main table, RCPE is usually below LongLLMLingua, which is the strongest aggregate baseline in both backbone settings; the reported gains are mainly over weaker base compressors. The risk-control claim is demonstrated only for one LCLM/Qwen configuration on LongBench. The other compressor/backbone combinations and ZeroSCROLLS are used for quality comparisons but do not receive the same certification analysis, so the central guarantee is not shown to transfer.
The controller is trained with many counterfactual generations whose labels are task-score changes measured against full-context behavior. This is an expensive and highly protocol-dependent source of supervision. The paper does not make clear how sensitive the result is to the trajectory orders, candidate chunking, and policy-family choices, nor does it report the total offline generation budget. In addition, the table’s “matched” operating point combines different methods with different policies and coverage behavior, making the quality–cost comparison harder to interpret than the presentation suggests. These are central experimental and validity issues rather than small presentation problems.
The related-work coverage is also incomplete. The paper should position RCPE against the following directly relevant works:
- COMI: Coarse-to-Fine Context Compression via Marginal Information Gain — ICLR 2026
- GMSA: Enhancing Context Compression via Group Merging and Layer Semantic Alignment — ACL 2026
- RECOMP: Improving Retrieval-Augmented Language Models with Compression and Selective Augmentation — EMNLP 2023
- In-context Autoencoder for Context Compression in a Large Language Model — arXiv, 2023
- Long-Context LLMs Meet RAG: Overcoming Challenges for Long Context Understanding — ACL 2024
These omissions make it harder to assess the novelty of the proposed controller relative to recent compression and retrieval-compression settings.
Questions for authors
Please report risk and coverage certification for every backbone–compressor pair and for ZeroSCROLLS. What is the total number of offline generations used to construct the controller labels, and how were trajectory order, chunk size, and the candidate policy family fixed before evaluation? Please also provide a comparison at a clearly identical coverage and end-to-end cost, including the strongest baseline rather than only the underlying compressor.