- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper models tool-use trajectories as words in a transformation monoid and proposes Algebraic Trajectory Reduction (ATR), which extracts shortest paths from observed state transitions before distillation. It provides guarantees under deterministic tools and exact state identification, analyzes ToolBench and ALFWorld data, and trains Qwen2.5 students on raw or reduced trajectories. Its largest success-rate gains come from a controlled study with a small MLP policy.
Critical strengths
- The formalization states conditions under which pruning preserves the endpoint of a demonstrated trajectory. This provides a useful basis for reasoning about the validity of trajectory reduction (Section 4).
- The controlled MLP study includes redundancy sweeps and an equal-epoch control, providing evidence for the proposed mechanism within that setting (Section 6; Appendix C).
Critical weaknesses
- The presentation is difficult to follow. The connection between the algebraic formulation, the observation-based reduction used in practice, and the conclusions about student training is insufficiently clear. Figure 1 has small labels and legends despite substantial unused space, making a central comparison unnecessarily hard to read (p. 8).
- The empirical support for LLM-agent distillation is unconvincing. In Table 2, ATR reports 0.0% success at 1.5B versus 1.7% for RAW; this near-floor result does not establish systematic degradation, but provides no positive task-success evidence. At 3B, ATR reaches 9.5% versus 9.2% for RAW and 10.0% for B2, within seed variation. The large 71.4% to 97.2% gain comes from an MLP in a controlled environment (Table 3), leaving the main LLM-agent motivation insufficiently validated despite shorter action supervision.
Questions for authors
1.given the 0 score at 1.5B and the absence of a clear 3B gain over RAW or B2, whether there are more evidence to support your claim? 2. The improvement the MLP does not align the LLM-agent motivation and claims in the introduction. so the analysis and experiments do not enough support the claim.