- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes SALT, which augments agent training trajectories with structured task states consisting of goals, constraints, facts, plans, and unresolved issues. The states are automatically generated through a writer–reviser–probe pipeline and used as additional supervision before action prediction. The method improves over standard SFT in 12 out of 15 settings across five benchmarks and three Qwen3 model sizes.
Critical strengths
- The paper is clearly written and addresses a relevant problem in multi-turn tool-using agents.
- The empirical evaluation covers several benchmarks, and the improvements over SFT are reasonably consistent, especially for the 4B and 8B models. I also appreciate the intervention experiment showing that the generated states can directly influence the agent's subsequent actions.
Critical weaknesses
-
Limited novelty relative to existing work.
- The main idea of explicitly supervising intermediate states before action generation is already well explored. In particular, PARL-MT constructs progress-awareness supervision from trajectories, including history summaries and future plans, and uses action reconstruction to validate the generated information. IACM-RL similarly trains agents to generate structured belief states before tool invocation. Earlier work such as UBAR also jointly models belief states and actions.
- While SALT uses a different five-field representation and annotation pipeline, I find the conceptual difference relatively incremental. The paper does not sufficiently establish why this particular decomposition offers a meaningful advance over existing state- or progress-aware training methods.
-
Insufficient controls to isolate the actual source of improvement.
- SALT introduces substantially more supervised tokens than standard SFT. For example, the supervised token count increases from 0.20M to 1.17M on WebShop and from 1.61M to 11.08M on OfficeBench. The rationale and flattened-state controls are useful, but they are only evaluated on WebShop with the 4B model. It remains unclear how much of the improvement comes from the proposed state structure versus additional intermediate supervision.
- I am also concerned about the construction of the state targets. Appendix A indicates that the demonstrated tool call can be appended to the plan field, including its arguments and provenance. The example in Appendix A.3 appears to contain an explicit specification of the subsequent gold action. This potentially introduces additional action-level supervision within the state targets. An ablation removing this information would be important for understanding the claimed benefit of task-state learning.
-
Limited evidence of generality.
- There is no independent evaluation of generated state correctness. The state intervention experiment demonstrates that actions depend on the states, but does not establish that SALT systematically learns more accurate state representations.
Questions for authors
- How does SALT compare with token-matched structured reasoning or progress-awareness SFT baselines across multiple benchmarks?
- What happens if the demonstrated tool-call specification is removed from the state targets? Does the method generalize when trained on one set of environments and evaluated on unseen domains?