- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper first demonstrates, through empirical analyses, that latent states in existing multimodal latent-reasoning methods may not encode meaningful semantic information. To address this limitation, it further proposes Information Control for Latent Reasoning (ICLR), a two-stage framework designed to make latent states both necessary for prediction and effective for reasoning. In particular, the first stage blocks direct access to the original visual input during answer generation, thereby routing task-relevant visual information through the latent states, after which the second stage restores visual access and distills step-relevant visual evidence and textual semantics into these states. Experiments show that ICLR outperforms existing latent-reasoning baselines, achieving state-of-the-art performance across various benchmarks.
Critical strengths
- The paper investigates the important question of whether latent states in existing multimodal latent-reasoning methods genuinely encode meaningful semantic information and contribute effectively to prediction.
- The paper proposes Information Control for Latent Reasoning (ICLR), a well-motivated two-stage framework that makes latent states both necessary for prediction and effective for reasoning.
- Extensive experiments across diverse multimodal benchmarks demonstrate consistent improvements over existing latent-reasoning baselines, together with substantially lower generation overhead than textual CoT.
Critical weaknesses
- The paper overclaims the scope and generality of its contributions. While it claims to systematically analyze existing latent-reasoning methods and presents ICLR as a general solution, all analyses and experiments are confined to multimodal latent reasoning, leaving its applicability to language-only latent reasoning unverified.
- The construction of step-level supervision is highly heuristic. Each CoT is divided into three approximately equal-length spans, while the visual targets are extracted from eight fixed attention heads. The paper provides no ablation on these settings, leaving it unclear whether the reported gains arise from genuine step-level alignment or from specific heuristic design choices.
- The experimental validation remains insufficient. Despite covering eight benchmarks, ICLR is evaluated using only one vision-language backbone. Moreover, the paper provides no budget-matched comparison between the complete method and its single-stage variants. These limitations make it difficult to assess the generalizability of ICLR and isolate the contributions of its two stages.
Questions for authors
- How can ICLR be extended to language-only latent reasoning, where visual-path masking and patch-level visual distillation are unavailable?
- What criteria are used to select the three latent steps, the approximately equal-length CoT segmentation, and the eight fixed attention heads?
- Are all latent-reasoning baselines in Table 1 trained and evaluated with the same backbone, data, and training budget as ICLR? If not, how can the reported gains be attributed to the proposed method rather than differences in experimental setup?