- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ECHO, a self-distillation framework for improving factual recall and reducing hallucinations in model reasoning without requiring gold answers or external verifiers during training. The main point is to exploit the asymmetry between factual generation and verification: a model may fail to recall a fact but can recognize it when presented. ECHO first identifies knowledge states using self-verification, then constructs a hindsight oracle by aggregating verified claims from multiple rollouts and selecting recall-sufficient cues. The student model is subsequently trained through entropy-guided on-policy distillation and an influence-gated grounding reward. Experiments across four language models show that ECHO achieves accuracy comparable to gold-supervised RLVR, while substantially improving reasoning-trace factual precision.
Critical strengths
- A meaningful self-supervised training framework that improves factual reliability without per-question gold answers. This is consequential because acquiring large-scale, high-quality factual supervision is particularly challenging for long-tail knowledge. Experimental results also show that ECHO improves factual reliability without introducing an additional inference-time module, which validates its practical relevance.
- A thorough empirical analysis and mechanistic evidence supporting the proposed explanation. Beyond standard benchmark comparisons, the authors conduct extensive ablation studies, knowledge-state analyses, and causal interventions to systematically validate the effectiveness of individual components and provide evidence that the improvements stem from better factual recall and increased reliance on verified cues.
Critical weaknesses
- Dependence on the Reliability of the Endogenous Verifier. The effectiveness of ECHO depends on the reliability of its endogenous verifier. When the model generates an incorrect claim that is mistakenly verified as correct, the resulting supervision may reinforce factual errors. As acknowledged in the limitations, ECHO may even amplify incorrect knowledge in such cases. Could the authors provide a simple statistical analysis, based on sampled cases, to quantify how frequently this issue occurs and how significantly it affects the training process?
- Limited Generalizability of the Triple-Based Fact Representation. ECHO represents factual claims as subject–relation–object triples, which may limit its applicability to more complex reasoning tasks. Many reasoning processes, such as multi-step mathematical reasoning, cannot be naturally expressed in this structured format. Could the authors discuss this limitation and clarify how the proposed framework might generalize to reasoning tasks that do not fit the triple-based representation?
- Limited synthesis across experimental findings. While the paper provides extensive empirical evaluations and useful interpretations of individual experiments, the discussion is often dense with quantitative comparisons across multiple metrics, ablations, and model settings. A more explicit synthesis across these findings would improve the clarity of the paper's overall conclusions.
Questions for authors
See Weaknesses.
4 comments
Thank you for the detailed rebuttal and additional experiments, and I especially appreciate your efforts concerning the quantitative analysis of verifier errors (W1) and the new PrOntoQA experiments (W2).
My remaining concern is primarily about the presentation (W3). The original concern was not about the contributions themselves, but rather the dense presentation of experimental results and the lack of clear synthesis across different experiments. While the proposed summary of contributions is helpful, it does not fully address this issue. Considering this presentation issue, I will maintain my original score.
Improving the experimental narrative and synthesis
Thank you for your continued engagement and constructive feedback. We are pleased to receive your positive feedback on our responses to W1 and W2. We also appreciate your clarification of W3 and apologize that our previous response did not adequately address the organization and synthesis of the experimental findings.
We commit to completing a careful revision of the main-text experimental discussion before the rebuttal period ends. We will retain the key experiments, integrate the essential appendix ablations and analytical conclusions into the main narrative, and reduce repetitive descriptions of numerical results. We will explain how the experiments connect and what they jointly establish about ECHO’s effectiveness, mechanism, and limitations. These revisions will improve the organization and explanation of the evidence without changing the paper’s main conclusions.
We will share the revised text for your assessment. We sincerely hope these revisions will help the technical contributions and their supporting evidence come through more clearly, and would greatly appreciate your continued feedback.
Revised manuscript and clearer experimental synthesis
Thank you for your continued feedback. We apologize that the original presentation made our findings difficult to follow. As promised, we have revised the main text throughout. The attached PDF marks changes in blue, with three main improvements:
- Clearer contributions and method (Sec. 1–3). We clarify the learning principle, the role of the verifier and its features, and the supervision boundary between default ECHO and ECHO-LF.
- Connected experimental evidence (Sec. 4). We reduce repetitive reporting, bring key ablation findings from the appendix into the main discussion, and explain how the teacher controls, recall interventions, and error-mitigation analyses support the conclusions together.
- Explicit scope and supporting evaluations (Sec. 4.6, Sec. 6, Appendix O). We incorporate the additional inference-time scaling and PrOntoQA experiments, summarize their implications in the main text, and clarify applications and limitations. These revisions preserve the core method and original conclusions while making the evidence easier to assess. We hope they address the presentation concerns and would be grateful if you could consider the revised manuscript in your final assessment.
Thank you for recognizing the framework and mechanistic evidence. We address the three concerns directly.
Thank you for highlighting the importance of this limitation. Section 6 explicitly acknowledges that confidently held errors can pass self-verification and be reinforced. Table 34 and its following analysis quantify the risk: wrong targets occur in 61 of 748 development TT questions and receive 7.6% of TT distillation weight. Across the TT pool, generation of these specific wrong targets increases by 1.5 percentage points. Such correlated errors are a structural risk of self-improvement or self-play driven by imperfect self-evaluation [1].
The paper introduces several measures to limit this risk, with corresponding evidence:
Stricter verification (Sec. 3.1). Raising the precision target to 0.95 reduces high-confidence wrong-teacher cases from 35 to 13, at a 31% reduction in TT coverage (Appendix J, analysis following Table 34).
Cue compression (Sec. 3.3). Retaining only recall-sufficient cues reduces contexts containing a false premise from 41.8% to 10.7% while preserving teacher accuracy (Sec. 4.3, Fig. 3c).
Training by knowledge state (Sec. 3.2, 3.4). NE questions are excluded from distillation. Removing this control increases hallucinated claims per NE trace from 1.21 to 1.62 (Sec. 4.4).
These results demonstrate risk reduction, while residual errors remain possible. We will consolidate this evidence and the coverage tradeoff in the revision.
We agree that the current representation reflects the paper's scope: factual QA, where our goal is to improve recall of parametric knowledge. The factual claims studied here can be decomposed into subject–relation–object triples for verification. More general reasoning lies beyond this original scope.
To test transfer beyond this scope, we evaluated Qwen3.5-9B on five-hop PrOntoQA instances [2]: 10,000 training and 2,000 test questions with disjoint ontologies. The frozen verifier checks each conclusion against its premises and inference rule. Verified intermediate steps, excluding the queried statement and its negation, condition the hindsight teacher. Trained variants use matched budgets and three seeds. The verifier uses 500 separate labeled calibration steps; training answers are withheld, and symbolic checking is confined to calibration and evaluation.
Verified self-training fine-tunes on self-approved complete solutions without hindsight conditioning. The ablation removes intermediate-cue checks while retaining the other components.
ECHO reaches 86.0% answer accuracy and 78.8% complete-proof validity, exceeding verified self-training by 3.9 and 7.6 points, respectively. Removing intermediate-cue verification reduces both. These results support transfer of ECHO's mechanism from factual recall to logical deduction by adapting the verification interface.
Thank you for suggesting a clearer synthesis. We will highlight three connected contributions:
Endogenous supervision from capability asymmetry. ECHO turns the gap between verification and generation into a hindsight teacher built from self-verified cues, without per-question gold answers or external feedback during training. Matched-label comparisons demonstrate the value of using limited supervision to enable this reusable learning signal (Sec. 3.1–3.3, 4.2).
A validated framework for reliable knowledge recall. Knowledge-state diagnosis, recall-sufficient cues, entropy-routed distillation, and influence-gated grounding teach models to recover and use relevant parametric knowledge. Our study across four models links this mechanism to factuality gains, including accuracy non-inferior to gold-answer RLVR on 9B/27B and improved short-form and long-form factuality (Sec. 3.2–3.4, 4.2–4.6).
Inference efficiency, complementarity, and transfer. As detailed in our response to Reviewer 24NV (W2), single-generation ECHO achieves higher factual precision than the evaluated inference-time scaling methods at substantially lower inference cost; combining it with CoVe further improves both accuracy and factual precision. Our response to W2 also shows that adapting the verifier and training on PrOntoQA transfers the mechanism beyond factual QA to logical reasoning, outperforming verified self-training in both answer accuracy and proof validity.
[1] Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops. Chen et al. arXiv 2026
[2] Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought. Saparov and He. ICLR 2023