- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes REVES to improve sequential answer revision in language models. It extracts revision and verification tasks from successful correction trajectories and trains the model using single-turn RL, with iterative data refresh. Experiments on coding, mathematics, constraint-satisfaction puzzles, and circle packing evaluate its effectiveness.
Critical strengths
I find the setting practical, especially for applications such as code debugging. Reusing incorrect intermediate answers as training inputs is a useful design that provides more direct feedback for learning to correct mistakes.
Critical weaknesses
-
The methodological novelty appears somewhat weak. The approach mainly combines trajectory filtering, data augmentation, and revision/verification training. The paper should more clearly explain its main conceptual advance over existing self-correction methods.
-
The presentation could be more direct. Considerable space is devoted to formal definitions and theoretical analysis before the practical training procedure is fully explained. A concrete example showing how a revision trajectory becomes training data would make the method easier to follow.
Questions for authors
How does REVES differ from existing methods for single-step improvement or joint revision and verification? What is its main insight and contribution beyond data selection and prompt construction?