- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents DCAgent, a tool-use vision-language agent designed to improve dense visual perception, particularly object counting and localization in crowded scenes. The key contribution is an adaptive divide-and-conquer framework that enables a VLM to recursively split images into smaller regions, detect objects locally, and merge predictions while removing duplicates. The authors train this multi-turn tool-use policy using GRPO with an end-to-end reward combining counting accuracy and detection quality, followed by a four-teacher Online Policy Distillation (OPD) approach that consolidates three task-specific agents into a single model while preserving general VLM capabilities. Experiments on SKU-110K, SODA-Aerial, and LVLM-Count demonstrate substantial improvements over the base Qwen3-VL-8B and direct SFT baselines, with additional evaluations on CountBench showing some generalization to unseen counting tasks. Ablation studies further examine the effects of the tool interface, reinforcement learning, overlap ratios, and merging strategies, supporting the effectiveness of the proposed framework.
Critical strengths
-
Well-motivated Method: The paper addresses a clear limitation of VLMs in dense visual perception through an adaptive divide-and-conquer framework. The integration of multi-turn RL and policy distillation is well motivated and effective.
-
Illustrative Qualitative Analysis: The paper provides clear qualitative examples across different tasks, effectively demonstrating the learned adaptive image partitioning strategy and improvements in object localization.
Critical weaknesses
-
Limited Novelty: Similar divide-and-conquer strategies for improving VLM visual perception have been explored in prior work. The proposed approach mainly extends these ideas with reinforcement learning and tool use, raising concerns about its methodological novelty.
-
Limited Generalizability: The performance improvements are largely restricted to dense object counting and detection tasks, while the model shows performance degradation on general VLM benchmarks. This raises concerns about whether the proposed method provides broadly useful capabilities beyond the specific training domains.
Questions for authors
Can you test the performance of using frontier agents such as Claude Opus for coding to solve this problem?