- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes three antidistillation methods. The proposed methods (Information removal, anchor, decoy) all act on the reasoning trace itself and do not modify the teacher accuracy. The authors include interesting negative results in section 4 about the decoy method. A benchmark is also provided which contains teacher traces generated by many teachers, which can be poisoned and used in distillation experiments. The core methods of this paper and experimented on extensively with multiple teachers and students, though only GSM8K and MATH are used as datasets.
Critical strengths
- The answer-preserving formulation of this work is important to maintain performance (in terms of answer correctness for users).
- Negative result 2 is a good result that actually justifies why some other antidistillation methods are not useful. In my opinion, this result should be expanded upon and used to justify why those methods aren’t valuable specifically.
- The benchmark with teacher traces can be valuable to the community to future work on new antidistillation methods.
Critical weaknesses
- The overall framing of the utility of this as an anti-distillation method is poorly explained. Currently frontier labs only provide the answer and no reasoning trace. The justification for why a frontier lab would want to provide the reasoning trace is that it can be helpful for the user, improve trustworthiness, etc. However this work is suggesting poisoning this trace with a decoy. Initial methods on this topic (Antidistillation Sampling) struggle because of the student-teacher accuracy tradeoff and the incoherency in the reasoning traces. This paper is proposing actively modifying the trace to make it contradictory, which is even less helpful for a user and potentially dangerous.
- This work is clearly missing important comparisons to recent work on this topic, including (but not limited to): The Distillation Game: Adaptive Evaluations & Efficient Defenses (Allouah et al) and Hiding in Plain Sight: Detectability-Aware Antidistillation of Reasoning Models (Hartman et al). While these may be considered concurrent works and not “need” to be referenced in this work, the fact that also Savani et al is discussed makes me question the thoroughness and validity of the author’s literature review and understanding of the problem area.
- Distillation results are not compared to relevant methods in the literature. I would argue that some of those methods, such as those who use an LLM to rewrite traces do not need to be compared against given the methodological issues with them, should not be compared against, however some methods are directly applicable. Without these direct comparisons, the true value of the methods proposed is unclear.
Questions for authors
- Can you show examples of what the reasoning traces look like post-poisoning? My intuition is that the decoy method, for instance, may make the reasoning trace unhelpful for the user.
- Can you compare your method to other methods in the literature? I have no way to know if your results are meaningfully better than existing methods without a direct comparison using the same experimental setup.
I’m quite saddened to not have my questions and concerns addressed. If the authors can provide an explanation for the utility of the decoy strategy and preliminary experiments to the concurrent work, I would be happy consider updating my score, but as it stands without response, I am inclined to maintain my current rating.