- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper introduces RePI a variand of self-distillation that uses other candidates of privileged information to improve the efficacy of self-distillation.
Critical strengths
The paper's motivation and idea seems good I liked the principle of studying how/where privielged distilattion is digested by the model. The results look good I like the pass@k results. Overall I don't have a problem with the paper's results or claims. I think I like the synthetic experiment if it means what I think it does.
Critical weaknesses
The paper is basically unreadable, I have no way to confirm but the paper reads as if it was written with heavy ai assistance. I found myself confused and while the sentences make sense the effort to digest what the authors are trying to communicate are significant. Section 3 for instance is trying to motivate why we need all this terms and theory but that portion is really hard to understand. I don't have gripes with this method or idea I think its neat, but the presentation needs significant improvement.
My rating is fairly dependant on the presentation if you guys can convince me that you will make substantial improvements and show me a better written draft I am confident I understand I am happy to move the rating. Again I like the idea behind the paper and makes sense.
Questions for authors
I don't have many gripes but I also don't quite know if I understood properly what was being presented. I think I did, I could nitpick a few things like having a single seed or that the experiements where only ran for 200 steps, but I think these are minor for a proof of concept. I'd like to see a multi turn setting for instance, just run this on textworld or alfworld, its cheap to run anyways.
Given the heavy importance given to privileged information this citation seems very relevant and should be added
Privileged Information distillation (https://arxiv.org/pdf/2602.04942)
4 comments
response
Thanks for the authors for addressing some of my points.
There are a substantial amount of edits to the manuscript and the paper reads completely differently. I still have concerns on the writing to be honest. The text reads heavily AI assisted and is often over verbose making it really hard to parse. I do think it is better tho.
Could the authors add the training curves as well to the appendix for everything (some are already there) including the newe text-world experiments?
Also some appendices e.g. (C.1 LEARNING DYNAMICS WITH GRPO are empty...).
Again I'm not opposed to this but I am not extremely happy about the presentation. I find the synthetic experiment still really hard to parse and don't think I understand it fully. Also figure 2 which is supposed to explain the method really does not do a good job at it and is really confusing.
I will maintain my rating for now that while the authors did improve the quality of the submission I think there remain substantial clarity issues with the manuscript.
If other reviewers are happy about the submission I am not against acceptance but am wary as the current version of the paper still heavily suffers from presentation issues.
Reply to Reviewer 4snk
Thank you for the candid feedback. We have focused this revision on the specific presentation issues you identified.
Training curves and appendices. We added the missing mathematics learning curves (Appendix C.9, Figure 10), which compare OPSD, RePI, and OP²SD at all three model scales and add the non-thinking model comparison. The TextWorld experiment was added during this discussion period as a smaller multi-turn check, and Appendix C.8 reports held-out success at the final checkpoint; we will extend it with the intermediate evaluations so that it matches the other experiments. We also added explanatory text to C.1 and C.2, shortened their figure captions, and corrected the appendix pagination.
Synthetic experiment. Section 3.3 now states the question and intervention directly: the teacher always sees all mappings, while we vary how often each key is requested in training queries. We clarified that evaluation uses held-out combinations of the same keys without privileged context, and scores the individual key–value assignments rather than the final sum. We also shortened the transition to RePI, distinguishing what the experiment establishes from the method it motivates.
Figure 2. We revised the accompanying explanation in Section 3.1 to guide readers through panel (a): student generation, teacher supervision at the same prefixes, and updates to shared parameters. We separately explain that panel (b) illustrates an observed acquisition pattern, not an additional training step.
Thank you again for reading the revision carefully. Your comments helped us identify where the explanation needed improvement, and we will continue to make the writing clearer and more concise.
Dear Reviewer 4snk,
Thank you again for your time and effort in reviewing our submission.
As the discussion period will end in 24 hours, we would like to kindly remind you that we have posted our responses to your latest comments. If you have any further questions or concerns, we would be happy to discuss them.
We sincerely appreciate your constructive feedback and thank you again for your time and consideration.
Response to Reviewer 4snk
We sincerely thank you for the candid review, and for your positive view of the motivation, idea and results. We respond to each point below, and we would welcome further discussion.
W1: Presentation and Section 3
We agree that readability was the main problem with the submission. We have revised the writing throughout the main text, with the largest changes in Section 3. Section 3 now opens with the question it answers, names the student and teacher roles explicitly when defining
OPSD, states in plain words what Proposition 1 implies, and ends by explaining how the finding leads toRePI. As disclosed in our AI Use Statement, we used AI tools when drafting and editing the paper. The submitted text was hard to read, and that is our responsibility.So that you can check your reading against ours, here is what Section 3 and the method say:
OPSD, one model plays two roles. As the teacher, it sees privileged information (e.g., a reference solution) and provides next-token targets on the response the student itself generated. As the student, it never sees that information. Section 3 asks which information in the teacher's context the student actually learns.OPSD, each reference solution supervises the student only on its own problem.RePIadds nine randomly drawn training problems with their solutions to the teacher's context and retains the current reference solution. The student input and the training objective are unchanged.If this matches your reading of the synthetic experiment, it is what the revised Section 3 is written to convey.
Q1: Multi-turn settings
Thank you for the suggestion. We ran Base,
OPSDandRePIon the Coin Collector task of TextWorld (multi-room navigation to find and pick up a coin) withQwen3-4B. At each turn the student chooses among the admissible actions. The teacher additionally sees the expert walkthrough for the current game, andRePIadds the walkthroughs of nine other training games. We train on 256 games and report success rate on 64 held-out games.OPSDRePIBoth methods improve over Base, and
RePIagain outperformsOPSD(75.0% vs. 71.9%).Q2: Related work
Thank you for the pointer. We have added this work to Related Work. Penaloza et al. [1] distill privileged information in multi-turn agentic tasks (τ-Bench, TravelPlanner). They introduce π-Distill and an on-policy self-distillation objective, and find that for the latter the information content of the privileged information is the strongest predictor of transfer. The two works are complementary: [1] examines which privileged information helps transfer, while we use a controlled experiment to examine at which student states privileged information induces supervision, and use this to choose the teacher's context.
We have uploaded a revised version of the paper, which includes the revised text, the multi-turn experiment (Appendix C.8) and the citation above (Section 2), with added and revised text shown in blue.
Reference
[1] Penaloza, E. et al. Privileged Information Distillation for Language Models. arXiv:2602.04942, 2026.