- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The current summary is highly complete as it captures the central thesis and main paradox of the paper, which is the decoupling of preserved verification ranking from degraded self-supervised learning value.
However, to make the summary even stronger and more robust for a conference review, we can add one additional sentence highlighting the core empirical finding: that solutions from a full precision generator can teach a learner significantly more than solutions from a quantized generator, even when the full precision solutions have much lower final answer correctness.
Here is an enriched version of the summary that includes this key nuance while strictly following all of your formatting constraints:
This paper investigates the self training of language models where the generator is a quantized version of the original model. The authors perform a comprehensive evaluation to benchmark various models and their quantized versions, revealing a crucial phenomenon: while quantized generators can preserve verification ranking and maintain high correctness in their final answers, making them appear to be excellent teachers, their intermediate reasoning steps and termination behaviors are severely degraded under quantization. This degradation produces poor and potentially harmful training signals for the learner. Notably, the authors demonstrate that full precision solutions can teach a model significantly more than quantized solutions, even when the full precision solutions have a much lower final answer correctness rate. Consequently, final answer correctness and verification robustness are insufficient criteria for assessing the quality and usefulness of self generated supervision.
Critical strengths
-
The paper introduces a highly rigorous evaluation framework that successfully decouples verification ranking, final answer correctness, and realized learning gain. By isolating these properties, the study goes beyond standard evaluations to precisely pinpoint how and where quantization damages the learning value of generated solutions.
-
The empirical scale of the work is robust, benchmarking a wide selection of model families and trainee sizes across a complete ladder of nominal bit widths.
-
The authors employ diagnostic methodologies, such as reciprocal continuations, to isolate whether generation failures are driven by the prefix or by the continuing model. This investigation into the mechanics of autoregressive feedback adds substantial technical depth.
Critical weaknesses
-
The paper suffers from severe structural fragmentation. The text is divided into numerous very small, paragraph long subsections and independent exploratory tests. This design makes the paper read like a collection of disjointed empirical observations rather than a cohesive, smoothly flowing story, which significantly hinders readability.
-
While the empirical findings are highly practical and provide useful warnings to the community, the overall novelty is relatively limited. The study primarily documents observations within standard training recipes without proposing new algorithms, architectures, or theoretical frameworks to mitigate the degraded learning value. This incremental contribution falls below the expectations for a top tier conference.
Questions for authors
-
The paper notes that the exact textual properties causing the learning difference remain unidentified. Do the authors have any hypotheses about which specific textual features of quantized solutions, such as lexical diversity, formatting styles, or subtle reasoning gaps in the step by step derivations, are responsible for the degraded learning value? How might future work systematically isolate and measure these hidden textual factors?
-
What potential mitigation strategies do the authors suggest to help recover the lost learning value of self generated solutions from quantized generators?