- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes MetaTide, a framework for multimodal reasoning that maintains evolving metacognitive seeds distilled from previous reasoning trajectories. The framework constructs a Meta-State to characterize ongoing reasoning, retrieves relevant seeds, and translates them into second-order control to guide task-specific reasoning. Completed tasks are used to update and consolidate the memory bank. Experiments across five multimodal benchmarks report substantial improvements over ReasoningBank, particularly on MATH-Vision and MuirBench. However, the methodological novelty relative to existing metacognitive memory approaches remains insufficiently established, and concerns about evaluation reliability, particularly the unusual numerical patterns in the reported results and unclear evaluation protocols, weaken confidence in the empirical findings.
Critical strengths
-
Interesting motivation. The paper investigates how accumulated metacognitive experience can guide future multimodal reasoning, addressing an important problem in experience-driven learning and adaptive reasoning.
-
Structured framework with component analysis. MetaTide integrates metacognitive state assessment, experience retrieval, second-order control, and continual memory evolution. The paper provides ablations examining memory evolution, retrieval, and second-order planning, together with analyses of intermediate regulation events.
Critical weaknesses
-
Concerning evaluation statistics and insufficient clarity about the evaluation protocol. All five reported MetaTide accuracies in Table 1 (51.61%, 64.52%, 67.74%, 61.29%, and 77.42%) correspond exactly, up to rounding, to integer multiples of 100/31 (16/31, 20/31, 21/31, 19/31, and 24/31). The same values appear for the MetaTide in Table 2, whereas none of the 15 results from the three ablation settings exhibit this pattern. This raises concerns about the effective evaluation sample sizes and whether the full model, ablations, and reported baselines were evaluated under identical conditions.
-
Limited novelty and insufficient differentiation from closely related work. The proposed framework substantially overlaps with existing methods, particularly ReasoningBank (ICLR 2026), MC2 (ACL 2026), and AdaMEM (2026). MC2 already investigates cross-instance metacognitive consolidation involving reasoning, monitoring, and control, while AdaMEM dynamically adapts strategies based on historical experience and the current reasoning state. Although these works are cited, the paper provides only brief conceptual distinctions and lacks direct experimental comparisons with MC2 and AdaMEM. The incremental methodological contribution remains unclear.
Questions for authors
-
Why do all five MetaTide accuracies correspond to integer multiples of 1/31? Were the full model, ablations, and baselines evaluated on identical benchmark subsets? Please provide the exact number of evaluated examples per benchmark, sampling procedures, evaluation configurations.
-
What fundamentally distinguishes MetaTide from MC2, ReasoningBank, and AdaMEM? In particular, what new capabilities does Metacognitive Interflow introduce beyond existing metacognitive consolidation and state-adaptive strategy generation? Could the authors provide more direct comparisons with these methods?
-
Can the authors provide compute-matched comparisons against ReasoningBank and simpler reflective reasoning baselines, and evaluate metacognitive seeds against generic or randomly retrieved reasoning strategies under identical inference budgets?