- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
ThymeV2 is a multimodal framework for sustained visual exploration that combines adaptive image cropping and zooming with an evolving visual memory, selectively removing unnecessary observations while preserving textual reasoning history. Its main contributions include ThymeData, a high-quality training dataset, and a two-stage training pipeline combining context-aligned supervised fine-tuning with reinforcement learning using outcome and process feedback. It also introduces StratBenchFinal, a challenging benchmark consisting of 893 manually verified visual questions. Across six perception benchmarks, ThymeV2 improves over its base models and approaches the performance of Gemini 3.1 Pro equipped with the same tools, while its memory mechanism reduces cumulative visual-token consumption compared with retaining all observations.
Critical strengths
-
Effective integration of visual exploration and memory management. ThymeV2 selectively removes obsolete visual observations while preserving reasoning history. Memory ablations show both higher accuracy and lower cumulative visual-token consumption than retaining all observations, providing concrete evidence that the design improves the effectiveness and efficiency of visual exploration.
-
A coherent training framework with strong empirical results. Context-aligned supervision and outcome- and process-based RL jointly address learning under changing visual contexts and recovering from tool errors. The substantial improvements over the base models across six benchmarks, together with training-stability ablations, support the practical value of this framework.
Critical weaknesses
- The experiments provide limited support for long-horizon exploration under finite context. Section 6.4 reports average interaction lengths of only 2.09–2.98 turns and an observed maximum of 11 turns, under a 15-turn budget. Appendix E further specifies a 262,144-token context limit, while Section 3.1 states that textual history is preserved when visual observations are removed. Thus, the experiments demonstrate adaptive short-to-moderate exploration, but do not establish sustained performance as interaction length grows under a fixed total-context budget. This gap is consequential because scaling exploration while controlling context growth is a central motivation of the paper.
- The memory ablation does not fully isolate the benefit of learned observation removal. Section 6.4 compares the full model against an “inference-time Append-All variant of the same checkpoint,” which disables visual-state removal. Accuracy falls from 71.69% to 64.15% on VisualProbe-Hard and from 62.48% to 59.57% on StratBenchFinal. Although these results support the usefulness of removal for the trained model, Sections 4.1 and 5 explicitly train it on dynamically maintained visual contexts, so the ablation also changes the training–inference alignment. Without an append-all model trained consistently under that setting, or budget-matched sliding-window baselines, the results cannot clearly distinguish the advantage of learned memory selection from distribution mismatch or generic context reduction.
Questions for authors
- Exploration scalability. Section 6.4 and Figure 3(a) report average interaction lengths of 2.09–2.98 turns and an observed maximum of 11 turns under a 15-turn budget. Moreover, Section 3.1 states that textual history continues to accumulate. These results appear insufficient to support the title’s claim of “infinite visual exploration” with “finite context.” Can the authors provide experiments with substantially larger interaction budgets, reporting accuracy, context growth, and computational cost, or narrow the claim to match the demonstrated exploration horizon?
- Memory management. Section 6.4 compares the full model with an inference-time Append-All variant of the same checkpoint, reducing VisualProbe-Hard accuracy from 71.69% to 64.15%. However, Appendix A.1 states that training inputs follow the dynamically maintained visual memory. Can the authors compare against a model trained to retain all context or a sliding-window baseline with the same visual-context budget? These comparisons would help distinguish the benefit of learned memory selection from adaptation to the training context and the benefits of simply limiting context size.
- Effectiveness of process rewards. In Section 6.3 and Table 2, the Pure Outcome baseline removes both process feedback and tool-error masking and exhibits tool-use collapse. This comparison does not isolate whether process rewards are responsible for the improvement. Can the authors report a controlled comparison that removes process rewards while retaining the same masking scheme and training budget, including benchmark accuracy and tool-error rates? This would clarify the contribution of process rewards to task performance and training stability.
- Reliability of the LLM judge. Section 5.2 uses an LLM judge to assign trajectory-level process scores and local penalties, which directly influence policy updates. Can the authors report agreement between these judgments and human assessments? Would replacing the judge with another reward model yield comparable training stability and final performance? These results would help establish the reliability and robustness of the reward signals.
2 comments
Thank you for the detailed responses and additional experiments, which address most of my concerns. I encourage the authors to include these experiments and their methodological details in the appendix.
I think the 15-turn budget in the experiments remains relatively limited and may constrain the model’s potential. I hope future work can scale to substantially longer horizons, moving closer to the goal of “infinite exploration.” My overall assessment remains positive, and I will maintain my original rating.
Dear Reviewer t2zq,
We hope you are doing well. As the discussion period nears its close, we wanted to kindly follow up and thank you again for your encouraging evaluation and deeply insightful expert feedback. Your suggestions regarding claim calibration, controlled memory-eviction baselines, isolated process-reward ablations, and judge reliability audits helped us bring out the strongest rigor and clarity of ThymeV2, all of which we have detailed in our response above.
Thank you once again for your thoughtful guidance and support. If our responses have addressed your questions to your satisfaction, we would sincerely appreciate it if you would consider raising your rating in support of our paper. Please let us know if there is anything else we can clarify!
Best regards, The Authors