- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces QUOTA, a method that reduces token consumption during multiple rounds of tool use by dynamically adjusting the retention ratio of each tool output. QUOTA keeps the parameters of both the agent and the compressor fixed. It makes retention decisions based on the current query and task progress. The reinforcement learning reward accounts for both task success and total token consumption throughout the interaction. It also penalizes additional tool calls. Furthermore, QUOTA uses an outcome prediction model to perform counterfactual comparisons. This model estimates the potential downstream costs of compressing individual tool outputs and provides more fine grained feedback for retention decisions. Experiments show that QUOTA reduces token consumption by approximately 29% to 46% compared with retaining all tool outputs, while maintaining or improving task success rates.
Critical strengths
-
QUOTA considers the impact of context compression on subsequent tool calls rather than optimizing only the immediate token compression ratio. Its optimization objective accounts for task success rate, total token consumption, and additional tool calls caused by compression. This allows QUOTA to better balance immediate token savings against the recovery costs associated with information loss. It also better reflects the requirements of practical agent applications.
-
QUOTA dynamically adjusts the retention ratio for each tool output based on query requirements, execution state, and tool output content without retraining the agent or compressor. By separating retention ratio allocation from the actual compression process, QUOTA offers greater flexibility and can be easily adapted to different agents and compressors.
-
The experiments cover a variety of compressors and tasks. Ablation studies evaluate the contribution of counterfactual credit assignment, while intervention experiments verify the consistency between counterfactual predictions and actual execution outcomes. Overall, the experimental design is relatively comprehensive.
Critical weaknesses
-
Counterfactual credit assignment relies on a learned outcome prediction model whose estimates lack rigorous causal guarantees. In addition, compressing different tool outputs may introduce complex interactions that could affect the accuracy of credit assignment.
-
The paper primarily reports token savings achieved by the agent without fully accounting for the cost of compressor calls in its main experimental metrics. Since different compression backends vary in computational overhead and latency, further evaluation is needed to determine whether these token savings translate into lower deployment costs.
Questions for authors
-
The paper emphasizes credit assignment for individual tool outputs. However, when the same tool is called multiple times, how does the method determine which historical output a subsequent call is intended to recover? If a single call recovers information from multiple outputs, how is credit assigned without double counting? These rules directly affect the training objectives of the credit assignment model, but they are not clearly explained in the paper.
-
The layout of the figures and tables on page 9 is cluttered and should be revised for clarity.