- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper proposes a group-normalized loss that equally weights opcode prediction and remaining action-token supervision to address token-length imbalance in agent policy distillation. A controlled 2×2 study on an adapted Qwen3-4B backbone, comparing loss formulations and expert versus replay training data across three seeds, reports 10.56–12.22 percentage-point improvements on synthetic partition-sum tasks, supplemented by failure diagnostics and distribution-shift tests.
Critical strengths
The matched 2×2 design controls training exposure and optimization budgets, providing useful evidence for the effect of loss reweighting within the studied setting.
Critical weaknesses
-
Insufficient novelty and missing competitive controls. The objective is a two-group weighted cross-entropy loss, closely related to existing segment-level reweighting approaches such as FunReason[1], yet no tuned opcode-weighted baseline or weighting sweep is reported. The experiments therefore do not establish a methodological advantage beyond increasing supervision on a short, task-critical span.
-
Claims substantially exceed the demonstrated scope. All positive results come from one parameter-binding-adapted Qwen3-4B backbone and a single synthetic partition-sum task family, while the joint-shift evaluation yields zero success across all tested conditions. This evidence supports a local training improvement, but not the claimed resolution of a fundamental bottleneck in agent policy distillation.
-
The primary effect is highly seed-sensitive. One seed contributes 77 of the 88 net additional successes underlying the headline replay improvement; the other two seeds improve by only 1.67 and 2.92 percentage points. With only three training seeds and confidence intervals conditional on those seeds, the evidence is insufficient to establish the magnitude and reliability of the claimed stabilization.
[1] FunReason: Enhancing Large Language Models' Function Calling via Self-Refinement Multiscale Loss and Automated Data Refinement. ACL findings 2026
Questions for authors
-
Methodological distinction: Are comparisons against tuned opcode-weighted cross-entropy or alternative group weights available, and what evidence distinguishes the proposed normalization from existing segment-level loss reweighting?
-
Scope and initialization: How was the shared parameter-binding parent trained, and what evidence supports extending the conclusions beyond this adapted backbone and the partition-sum task family?
-
Seed robustness: How sensitive is the primary replay estimate to individual training seeds, and are additional independent runs or seed-aware uncertainty estimates available to substantiate the claimed stabilization?