- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2(+1)
Read review
Paper summary
This paper proposes Long-Zero, a post-training framework for long-context language models that constructs answer-ranking pseudo-labels by progressively removing query-relevant evidence from a document. It further introduces a feedback-driven curriculum controller that adjusts the relevance-mass gap between successive context views based on the policy's ranking rewards. Experiments on LongBench v2 and HELMET show improvements over the corresponding base models, with particularly promising gains in passage reranking.
Critical strengths
- Interesting supervision strategy. Using controlled evidence degradation to construct ranking targets without reference answers is a potentially useful direction for long-context post-training.
- Clear presentation and empirical motivation. The overall framework is relatively easy to follow, and the experiments provide initial evidence that the proposed procedure can improve downstream long-context performance.
Critical weaknesses
CW1. The related-work review systematically misses important research directions.
The related-work section does not adequately cover several important subareas of recent long-context training research: (i) RL with verifiable context-level or process-level rewards, such as LongRLVR (Chen et al., 2026) and LongPAS (Peng et al., 2026); (ii) long-context preference optimization and context-chunk-based preference construction, such as LongMab (Duan et al., 2026); and (iii) long-context reward modeling, as studied by LongRM (Tang et al., 2025). More broadly, it lacks systematic coverage of reference-free pseudo-labeling and self-feedback methods, such as Self-Rewarding Language Models (Yuan et al., 2024), as well as reward-driven adaptive curriculum learning, exemplified by AdaRFT (Shi et al., 2025). The issue is therefore not simply a few missing citations, but an incomplete coverage of the research landscape directly relevant to the paper's two central contributions.
CW2. The novelty of both contributions is insufficiently established.
The missing related work directly undermines the novelty claims. LongMab already uses feedback-guided context-chunk selection to generate responses and construct preference pairs for long-context post-training; Self-Rewarding Language Models explores automatically generated preference signals; and AdaRFT adjusts training difficulty according to recent reward feedback. These methods are not identical to Long-Zero, but they establish important precedents for its central ideas. The paper needs to explain more precisely what is fundamentally new about using evidence degradation to define answer rankings and about adapting the relevance-mass gap, rather than presenting these broad ideas as novel without sufficiently distinguishing them from existing approaches.
CW3. The experimental evaluation lacks essential baselines at multiple levels.
The current comparisons against Base and SFT do not adequately establish the value of the proposed mechanisms. I encourage the authors to consider three levels of baselines: (i) long-context alignment methods, including LongMab, LongReward, and, where the task and supervision permit a fair comparison, LongRLVR; (ii) reference-free pseudo-labeling or self-feedback methods, such as Self-Rewarding Language Models and related approaches; and (iii) mechanism-level controls, including random ranking targets, random evidence deletion, fixed-gap training without the adaptive controller, and training with the ranking reward in Equation 6 instead of Equation 7. Not every method necessarily admits a fair direct comparison, but the paper needs to select suitable alternatives and justify the comparison protocol. Without such evidence, it is difficult to determine whether the reported gains result from information-degradation supervision, adaptive curriculum learning, or simply performing additional post-training.
CW4. Missing ablations leave the mechanism and downstream results insufficiently validated.
The paper provides no component ablations that isolate the contributions of evidence degradation, the ranking objective, and adaptive curriculum control. The LongBench v2 results also do not consistently outperform SFT in Overall scores, while the stronger HELMET results are concentrated in a task structurally close to the training objective. The relationship between learning to rank candidate answers and improving direct answer generation is not sufficiently investigated. Moreover, the training-dynamics analysis relies on a single 7B trajectory, and the paper acknowledges that repeated seeds and matched-compute comparisons remain necessary. Together, these limitations prevent the experiments from establishing which proposed components are responsible for the observed improvements and how robust those improvements are.
CW5. The core assumptions underlying the pseudo-labels are not empirically validated.
Long-Zero relies on two assumptions: more available relevant evidence tends to produce better answers, and the relevance scores used to remove document chunks adequately reflect the amount of useful evidence retained. Neither relationship is independently established. Semantic or query relevance is not equivalent to evidential sufficiency, and removing evidence need not monotonically reduce answer quality. Moreover, when all chunks have already been removed, subsequent views can contain identical contexts while still receiving strictly ordered labels. Acknowledging these issues in the limitations section does not establish that they have a negligible effect on training. The paper should quantify the reliability of the induced rankings, examine cases where the proxy ordering disagrees with actual answer quality, and investigate how relevance scores relate to the amount of usable evidence.
CW6. The reward actually used for training does not appear to implement the stated ranking objective.
Equation 6 defines standard candidate-pair Kendall agreement using candidate identities and their positions, whereas Equation 7—the reward used in the experiments—compares the numerical values in the predicted and target candidate-ID sequences. These formulations are not equivalent: Appendix A reports that they disagree on 296 out of 576 pairs of permutations for four candidates, and even gives an example in which their rewards have opposite signs. In particular, Equation 7 appears to make the reward dependent on the arbitrary numerical assignment of candidate IDs, rather than solely on the agreement between the predicted and target rankings. This raises a fundamental concern about whether the policy is optimized toward the intended objective. The authors should justify why Equation 7 is used as the training reward despite its disagreement with the standard candidate-pair ranking objective in Equation 6. More importantly, they should establish that Equation 7 measures the intended ranking agreement and verify whether the main results hold when training with a candidate-identity-based ranking reward.
References
- Chen, G., Shieh, M. Q., & Bing, L. (2026). Longrlvr: Long-context reinforcement learning requires verifiable context rewards. arXiv preprint arXiv:2603.02146.
- Peng, M., Shen, W., Chen, N., Li, C., Yan, M., & Li, J. (2026). Incentivizing in-depth reasoning over long contexts with process advantage shaping. In Findings of the Association for Computational Linguistics: ACL 2026 (pp. 26201-26228). First published on 18/1/2026: https://arxiv.org/abs/2601.12465
- Duan, S., Huang, P., Li, X., Liu, Z., Yi, X., Yan, Y., ... & Sun, M. (2026). Chunks as arms: Multi-armed bandit-guided sampling for long-context llm preference optimization. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (pp. 3559-3575). First published on 19/8/2025: https://arxiv.org/abs/2508.13993
- Tang, Z., Ji, B., Qiu, Q., Wang, H., Liang, X., Li, J., & Zhang, M. (2025). Longrm: Revealing and unlocking the context boundary of reward modeling. arXiv preprint arXiv:2510.06915.
- Yuan, W., Pang, R. Y., Cho, K., Li, X., Sukhbaatar, S., Xu, J., & Weston, J. (2024). Self-rewarding language models. arXiv preprint arXiv:2401.10020.
- Shi, T., Wu, Y., Song, L., Zhou, T., & Zhao, J. (2025). Efficient reinforcement finetuning via adaptive curriculum learning. arXiv preprint arXiv:2504.05520.
Questions for authors
What exactly does represent operationally? Please clarify how the target relevance-mass gap determines the evidence removed between successive views, including the effects of chunk-level overshoot and the special case of diffuse relevance scores.