- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces a fine-grained perception method aimed at preserving relative spatial arrangements (such as left-to-right and top-to-bottom spatial relations) among multiple objects.
Critical strengths
- The motivation is reasonably sound, and the experimental results demonstrate the empirical effectiveness of the proposed approach.
- The manuscript is clearly written and easy to follow.
Critical weaknesses
- Flawed foundational premise compared to training-based methods: ZwZ represents a typical training-based paradigm that requires zero image-level manipulation/cropping during inference and naturally preserves the full contextual information of the scene. Consequently, it fundamentally sidesteps the core motivation claimed in this paper, namely, that excessive visual context inherently degrades fine-grained perception.
- Questionable necessity & trade-offs on general capabilities: The necessity of training-free methods remains unconvincing. Compared to training-based approaches, training-free interventions often lead to severe performance drops on general multimodal benchmarks (e.g., MMStar), a trade-off that is not properly evaluated here.
- Missing perspective against frontier models: How do state-of-the-art closed-source multimodal foundation models perform on these fine-grained perception benchmarks? Given their rapid progress, is such a training-free pipeline still relevant or practically justifiable?
- Missing latency/runtime benchmarks: A rigorous comparison of inference latency and computational overhead against training-based methods like ZwZ is noticeably absent.
Questions for authors
- What are the concrete advantages of the proposed method when compared directly with training-based approaches like ZwZ (in terms of accuracy, generalizability, and deployment cost)?
- Considering the significant per-sample inference latency typical of such methods, could the authors clarify the target real-world application scenarios where this approach would remain practical?
5 comments
Dear Reviewer aZWo,
Thank you for your valuable feedback. We have carefully addressed your concerns in our rebuttal.
As the discussion period is coming to an end, we would greatly appreciate it if you could review our responses and let us know if you have any remaining concerns.
Thank you for your time and consideration.
Best regards,
The authors of Paper Submission40345
Feedback
-
What evidence supports the claim that both too much and too little context can be harmful?
-
The 70.16% result reported for the ZwZ-7B baseline is substantially below the performance reported by the ZwZ authors. As such, it does not seem to be a reliable representation of ZwZ. If this is the performance obtained under your setup, the original model may be a more appropriate baseline.
-
The claim that you trained a model using the ZwZ recipe with crops generated by PostCrop raises several questions. What evidence shows that PostCrop produces better crops? A 0.5% gain seems too small to distinguish from run-to-run variation. More importantly, the time required to construct the training data should be considered: at scale, even a modest increase in per-example processing time could lead to substantial overhead. How many GPUs did you use, and how long did training take? I am also unsure whether the evaluation sufficiently addresses practical utility and the potential value of this work to the community.
-
Based on the current results, training-free methods appear to be substantially less effective than trained methods, which raises questions about their practical viability.
-
In light of the issues raised in the rebuttal, I am considering lowering my score. Some of the information provided could give readers an inaccurate impression of the state of the field, particularly those unfamiliar with related work. I find this concerning. At the same time, I appreciate that the authors have acknowledged some limitations of their experiments, especially regarding efficiency. This leaves me conflicted: I might view the work more favorably if its claims and contribution were framed more narrowly.
We thank the reviewer for the thoughtful and constructive feedback. We would like to address each concern below. We have uploaded the rebuttal revision.
We compare PostCrop with ZwZ in terms of motivation, performance, and practical significance.
W1: How does the motivation of PostCrop compare with that of ZwZ?
First, the main motivation of the original manuscript is not simply that "the more context there is, the worse the model performs." Rather, a more complete view is that both too much and too little context can be harmful. The key is how to select appropriate context.
Second, our motivation remains valuable compared with the ZwZ paradigm. We acknowledge that our motivation is essentially about cropping, or, more specifically, better cropping. In fact, the ZwZ paradigm also relies on crop quality during training, because good crops can produce higher-quality synthetic data. PostCrop can contribute to this, and the two works are compatible.
To verify the complementarity between training-free visual localization methods and trained fine-grained perception methods, we use PostCrop-7B (Qwen2.5-VL-7B) to locate and crop key regions in the training images. We introduce the resulting high-quality crops into the Region-to-Image Distillation (R2I) training process of ZwZ-7B to provide more precise regional visual supervision, and train ZwZ-7B-postcrop using the same training configuration.
Q1/W4: How does PostCrop compare with ZwZ in terms of performance?
In the first table below, we compare ZwZ-7B and ZwZ-7B-postcrop in terms of accuracy on VSTAR, computational cost, inference latency, and generalization ability. On V*, compared with ZwZ-7B, the model trained with PostCrop crops is expected to achieve higher fine-grained perception accuracy while maintaining roughly the same inference latency and memory usage as ZwZ-7B.
In the second table below, we compare ZwZ-7B and PostCrop-7B in terms of accuracy on VSTAR, computational cost, inference latency, and performance on MMStar, which reflects generalization ability. PostCrop brings higher computational cost and latency on VSTAR, and its generalization to general tasks on MMStar is somewhat weaker. However, PostCrop substantially improves fine-grained perception while largely preserving the model's basic capabilities.
Q2: What is the practical significance of PostCrop?
PostCrop aims to produce better crops and improve the perception of fine details. As shown in Figure 5, it controls the influence of context within a crop, particularly for multi-object perception involving depth relations and tables. This may make it suitable for industrial scenarios with high-resolution images and complex visual elements. Fine-grained perception should not rely on localization alone. Other visual elements also need to be considered because correct localization does not necessarily lead to a correct answer.
W2: How does PostCrop perform on MMStar?
PostCrop's performance on MMStar decreases slightly, but its fine-grained and coarse-grained perception abilities show the expected improvements. The specific reasons are provided in Appendix Table 13 of the manuscript.
W3: How does PostCrop compare with closed-source models?
For a comprehensive evaluation, we selected two representative closed-source models, GPT-4o and OpenAI o3, as shown in the table below.