- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies instruction tuning for new-task adaptation while retaining general capabilities. It proposes LMATE, which constructs training targets through three rounds of teacher-guided revision: a stronger teacher accesses the reference demonstration and critiques a frozen student's response, and the student revises its answer using this feedback. The student is then fine-tuned on the revised responses, with the loss restricted to a prefix ending at the k_diff-th token-level edit relative to the initial response. The paper also introduces SELFTEACHSFT, a mixture of reference-model completions and ground-truth demonstrations. Experiments use Qwen2.5-3B-Instruct on chemistry question answering, tool use, and recent-event knowledge acquisition, measuring retention with IFEval and MMLU-Pro. LMATE improves over SFT on tool use and timely events, although its advantage over SELFTEACHSFT is task-dependent and substantial forgetting remains in the skill-learning settings.
Critical strengths
-
A well-motivated approach to adaptation with retention. Teacher-guided revision and prefix supervision offer a practical way to incorporate task information while limiting changes to student-generated responses.
-
Evaluation of both adaptation and retention. The paper reports results across three tasks with multiple random seeds and includes a useful simple baseline. LMATE improves both target performance and retention over SFT on Tool-Use and Timely Events.
Critical weaknesses
-
Limited evidence for the incremental contribution. The main ideas build on existing critique-guided training and self-distillation approaches. The ablations do not sufficiently establish the added value of student-side revision and the edit-bounded prefix objective.
-
Insufficient explanation of task-dependent performance. On Science Q&A, LMATE has mixed results relative to SFT and lower mean scores than SELFTEACHSFT across all three metrics. The paper does not adequately explain when or why its additional mechanisms are beneficial.
-
Unclear computational cost-benefit trade-off. LMATE requires a larger teacher and multiple feedback–revision rounds, but the additional data-construction cost is not quantified. Its practical advantage over the simpler SELFTEACHSFT baseline therefore remains unclear.
-
Insufficient evidence for distribution preservation. Limiting token edits does not necessarily keep the training targets close to the student's distribution. The paper does not directly validate that this mechanism limits distribution shift and thereby reduces forgetting.
Questions for authors
-
Can you clarify whether the existing experiments include training on the full revised responses, and provide a comparison against a prefix control matched for supervised-token count? The retained-prefix length distribution and loss normalization would help determine whether edit locations, rather than reduced supervision alone, account for the gains.
-
Can you provide a matched-retention comparison with SELFTEACHSFT and report the end-to-end cost of constructing the LMATE targets? This would clarify whether LMATE improves the practical trade-off over the simple baseline, particularly given the Science Q&A and Timely Events results.
As the author has not yet responded to my questions, the original score remains unchanged.