- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper investigates how to make more effective use of data in agent training and proposes a new algorithm that classifies and rewrites trajectories to better exploit the diverse types of information they contain. The authors evaluate the proposed approach on three datasets and demonstrate its effectiveness through experimental results.
Critical strengths
- The paper is motivated by a sound premise that effectively leveraging the diverse types of information contained in different trajectories. The proposed algorithm offers a potential solution to this problem and may provide insights for researchers working on agent training.
Critical weaknesses
-
The paper lacks an in-depth analysis of the experimental findings. Sections 4.2 and 4.3 primarily report numerical results from the tables without offering sufficient interpretation or discussion. As a result, it remains unclear why the proposed approach works, whether it generalizes to larger models, and what limitations it may have. Given that the paper is only eight pages long, excluding the “Limitations” section, nearly a page could be devoted to a more thorough analysis of these questions.
-
The proposed algorithm is based on DPO, yet the paper does not include a direct comparison with the DPO baseline. This omission makes it difficult to determine whether the proposed modifications provide meaningful improvements over the underlying method and weakens the logical consistency of the paper’s argument.
-
A more serious concern is that the LER results reported in Tables 1 and 2 appear to be completely inconsistent. This discrepancy raises significant concerns about the reliability and reproducibility of the experimental findings.
Questions for authors
- Some references cite the published versions of papers, but the corresponding URLs still link to their arXiv preprints. The authors should update these URLs to point to the official publication pages, where available, to ensure consistency and adhere to standard academic practices.