- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes DIP-CountVLM for open-world counting. It introduces IAFF to fuse multi-layer features and DITR to reconstruct dense visual tokens through input-representation cross-attention, aiming to move beyond global semantic alignment toward instance-level perception. It also builds DenseCountBench by reorganizing four counting datasets into low-, medium-, and high-density splits. Experiments report improved overall HitRate.
Critical strengths
- The paper is well-organized and easy to follow and understand.
- The motivation that global image-text alignment in VLMs is insufficient for dense instance counting is reasonable.
- The method direction is intuitive. The authors exploit complementary multi-layer features and attempt to recover spatial details.
- The experiments are relatively systematic, covering component analysis, dynamic/fixed fusion, frozen/trained DITR, and feature-layer selection on various scenes.
Critical weaknesses
- The novelty is relatively limited. For instance, IAFF is essentially a simple weighted fusion of multi-layer visual features, which is similar to popular multi-level feature methods (e.g., FPN [Lin et al., CVPR 2017], and MMFuser [Cao et al., ICPR 2026]), while DITR performs image-guided input-representation cross-attention, which is similar to recent feature upsampling methods (e.g., JAFAR [Couairon et al., NeurIPS 2025] and AnyUp [Wimmer et al., ICLR 2026]). The authors are recommended to provide a discussion or comparison.
- The central dense-instance claim is not convincingly supported by experiments. The gains of DIP-CountVLM in tab. 1 are concentrated mainly in the low-density regime, while medium-density results are inconsistent, and high-density results show essentially no meaningful improvement. A similar issue arises in the ablation study in tab. 2. In addition, the main paper figures also do not directly visualize whether DIP-CountVLM produces better instance-level representations/attention than the compared VLMs (fig. 1 and fig. 3 mainly provide comparisons among general VLMs).
- Some descriptions of the main components are not clear enough to understand in the main paper. For instance, DITR involves a feature-agnostic layer, downsampling, and Q/K/V branches, but the paper does not formally define these operations. Some important architectural choices are not explicitly specified in the method section, for instance, how the feature-agnostic layer is implemented and the downsample/upsample ratios.
Questions for authors
In addition to the weaknesses above, the reviewers are also willing to discuss the following issues with the authors:
- Is HitRate@100% too strict as the sole evaluation metric? Since this metric requires exact count matching, many methods achieve near-zero scores, especially in dense scenes, which limits its ability to differentiate methods. Do the authors consider reporting more tolerant HitRate values or standard counting metrics such as MAE/MSE?
- How does DenseCountBench actually reflect the 'open-world' setting? Beyond repackaging existing counting datasets into language-guided queries, does the benchmark include synonyms, unseen categories, or natural language descriptions of category attributes? Without this, it is unclear whether the benchmark truly evaluates open-world generalization rather than category-specific counting.