- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes ReState, a unified iterative reasoning framework for MLLMs that treats intermediate reasoning chains as updatable states. Unified Reasoning State Modeling (URSM) jointly trains a single model to construct reasoning from empty states, preserve correct reasoning, and correct erroneous reasoning. Closed-Loop Reasoning-State Learning (CRSL) incorporates self-generated historical states during training and recursively refines reasoning during inference to mitigate the training–inference reasoning-state gap. The authors also introduce VersaCoT-10K, a dataset of 10,000 single-image multiple-choice samples spanning eight visual reasoning domains.
Critical strengths
- The paper addresses a practically relevant problem: the mismatch between pre-constructed reasoning chains used during training and model-generated reasoning encountered at inference. Incorporating self-generated historical states is a well-motivated approach to mitigating this mismatch.
- ReState offers a simple, unified framework for reasoning construction, preservation, and correction within a single model. Reusing the same model for iterative refinement avoids the need to deploy a separate critic or correction model.
Critical weaknesses
- The paper uses CRSL to iteratively refine reasoning at inference time to improve answer accuracy, but does not provide an explicit adaptive stopping criterion. According to Appendix C, the refinement trajectory is fixed at nine rounds, and the peak accuracy is reported. However, it is unclear whether the best-performing round is selected using a validation set. In practical deployment, GT answers are unavailable to identify the best round, and the paper does not specify a mechanism for determining when to stop or which intermediate output to retain. This leaves a gap between the reported evaluation protocol and a deployable inference procedure.
- The incremental contributions and performance advantages over MIND require stronger justification. The construction of positive and negative reasoning states follows MIND’s RAD paradigm, and the ScienceQA and M³CoT experiments use the corresponding RAD versions. The main additions thus consist of unified state updates within a single model and feedback from self-generated historical states. Yet ReState outperforms MIND by only 0.18–0.91 percentage points on M³CoT and 0.90–1.70 percentage points on VersaCoT-10K. Without standard deviations across independent runs or statistical significance tests, and given that the reported results represent peak accuracy along the refinement trajectory, the robustness of these gains remains unclear. Moreover, in the non-iterative setting, although inference cost is comparable to MIND, the gains on VersaCoT-10K are narrow to 0.15–0.90 percentage points.
Questions for authors
- To clarify whether the gains reflect consistent error correction rather than answer fluctuations across rounds, could the authors report the proportions of samples transitioning from incorrect to correct and from correct to incorrect at each refinement round?
- The dataset’s reasoning annotations and quality assessment both rely on Gemini. Did the authors conduct human verification? Could you provide a user study to substantiate the dataset’s quality and reliability?
- The construction of VersaCoT-10K is described only briefly in Section 5, with most details deferred to Appendix A. Could the authors provide more specific construction details in Section 5? Otherwise, readers may find it difficult to understand how the dataset is constructed.
- All experiments are conducted on Qwen series. Could the authors evaluate ReState on MLLMs from other model families to verify its generality?