- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies multi-image re-representation in multi-image understanding and introduces a unified perspective that views textual re-representation and visual re-representation as two approaches for organizing visual evidence. The authors design the Mosaic visual harness, which supports various composable image operations, and construct the MosaicBench benchmark to evaluate different re-representation settings. Furthermore, the paper trains MosaicAgent-8B with GRPO-based reinforcement learning to learn multi-step visual tool usage. Experimental results show that visual re-representation provides advantages on tasks requiring fine-grained visual comparison, orientation-sensitive reasoning, and spatial relationship understanding.
Critical strengths
- The paper introduces the perspective of multi-image re-representation, viewing textual and visual re-representation as different ways of organizing visual evidence. Through systematic experiments, it examines the performance of different re-representation settings across multi-image understanding tasks, revealing the task-dependent benefits of visual re-representation and providing valuable empirical insights into the role of visual intermediates in multimodal reasoning.
- The paper introduces a visual harness with composable image operations and a grounding-focused benchmark. Mosaic supports multi-step visual operations and the reuse of visual intermediates through a persistent image workspace, while MosaicBench covers visual challenges such as orientation, precision comparison, hypothesis testing, and spatial reference, providing a useful benchmark for evaluating fine-grained multi-image understanding.
Critical weaknesses
1.The experimental comparison of different re-representation settings involves confounding factors. Appendix A.2 shows that the tool mode not only provides access to visual tools but also includes image sizes, tool and canvas conventions, and explicit planning and reflection requirements, which are absent in the no-tool mode. Although the authors acknowledge these differences, they do not provide controlled experiments that isolate the effects of tool access from prompt differences. Furthermore, visual tool use introduces additional inference overhead, while comparisons under matched computational budgets remain insufficient. Consequently, the performance gains cannot be fully attributed to visual re-representation itself, weakening the conclusions. 2. The technical novelty and cross-task generalization of the method require further validation. Mosaic primarily integrates existing image operations, while MosaicAgent-8B employs standard GRPO with accuracy and format rewards, leaving its distinct technical contributions over existing visual tool-based reasoning methods insufficiently demonstrated. Moreover, the training data selection favors examples that benefit from tool use, potentially limiting generalization. The performance gains are mainly concentrated on MosaicBench and M4Bench, with smaller or inconsistent gains on Mantis, BLINK, and MMIU, leaving broader cross-task generalization insufficiently validated.
Questions for authors
- When comparing different re-representation settings, could the authors provide controlled experiments that match general reasoning instructions, image metadata, and inference budgets to better isolate the benefits of visual re-representation from prompt differences?
- The training suite is selected based on the outcomes of tool-enabled rollouts and a no-tool run. Could the authors provide comparisons with randomly sampled or unfiltered training data to assess the impact of this selection strategy on model performance and generalization across benchmarks?
- The paper reports a substantial increase in tool calls after reinforcement learning. Could the authors provide comparisons of end-to-end inference latency, token usage, and computational cost, and further analyze the trade-off between additional inference overhead and accuracy improvements?
3 comments
Thank you for the detailed responses and additional experiments. The authors have addressed my concerns. I maintain my original rating.
Dear reviewer,
Thanks again for your valuable feedback and positive acknowledgment.
Thank you for your constructive feedback!
W1 & Q1: controlled experiments We added a matched-prompt no-tool reference across five benchmarks (
Section 4.1, Table 1). V-Re² improves over the matched reference from 37.3% to 47.2% on MosaicBench and 48.0% to 51.8% on M4Bench for Qwen3-VL-8B, and from 42.3% to 63.3% and 49.8% to 61.8% for MosaicAgent-8B. We also make the additional inference budget explicit: total tool calls increase from 1,830 to 3,037 (1.66x) after training (Section 5.2, Figure 4), and V-Re² raises MosaicAgent-8B accuracy from approximately 47% to 62% with higher token consumption (Section 5.2, Figure 6). The matched no-tool scores are also lower than the original T-Re² scores, confirming that performance depends on combinatorial factors including the prompt and the model's de-facto action space rather than on independently additive components. The controlled results therefore rule out the original prompt difference as the sole explanation while preserving the paper's task-dependent conclusion.Table 1 is reproduced below (accuracy, %). T-Re² is the original no-tool setting; T-Re²† is the matched-prompt no-tool control.
W2: novelty and generalisation
Q2: Training data selection: Our rollout-based selection is not post hoc selection of favourable evaluation cases; it constructs an effective training distribution for group-relative agentic RL. With eight tool-enabled rollouts, examples for which all rollouts succeed or all fail provide no group-relative signal from answer accuracy, because their within-group accuracy rewards are identical. This is the same motivation as DAPO[1] and others[2]’s dynamic sampling, which removes prompt groups with accuracy 0 or 1 to avoid zero-advantage policy updates. Our evaluation data are independently constructed after excluding overlap with the training suite at the sample, source-provenance, and image-similarity levels.
Q3: inference overheads: The revision quantifies inference costs through two comparisons. Total tool calls increase by a factor of 1.66 after training (
Section 5.2, Figure 4). The accuracy-token comparison shows that V-Re² raises MosaicAgent-8B accuracy from approximately 47% to 62% with more token consumption (Section 5.2, Figure 6). The trained policy uses more inference and obtains a substantially larger accuracy return on MosaicBench. The additional inference budget therefore yields a substantially larger accuracy return with the trained policy.The accuracy–token comparison in Fig. 6 is summarised below. Values are approximate readings from the plot; k denotes thousands of tokens. These are the Fig. 6 measurements, reported separately from Table 1.
[1] Dapo: An open-source llm reinforcement learning system at scale, 2025 [2] Online Difficulty Filtering for Reasoning Oriented Reinforcement Learning, 2026