- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes UVA, a fine-grained vision-language classification framework. The method combines combines Attention-guided Bounding-box Selection (ABS), Bi-directional Fine-grained Text Alignment Description Refinement (BiFTA-DR), lightweight visual and textual residual adapters, and Weighted Cross-Alignment (WCA). The adapters are trained to improve the alignment between local visual regions and fine-grained textual descriptions. Experiments on Oxford-IIIT Pet, ImageNet-100, and CUB-200-2011 show the largest improvement on CUB, where UVA reaches 80.29% accuracy in the 16-shot setting compared with 61.17% for the zero-shot regional baseline. The paper further introduces a “Difficulty-Scaling Rule” based on the observation that adaptation gains increase as the zero-shot task becomes more difficult, and uses agreement between WCA and LaZSL as an unsupervised confidence signal.
Critical strengths
- The paper addresses an important problem in fine-grained vision-language recognition, where subtle local visual differences are difficult to align with textual descriptions.
- The method achieves a substantial accuracy improvement on CUB-200-2011, clearly outperforming the compared few-shot baselines.
Critical weaknesses
- Limited novelty: the method is largely a combination of existing components (ABS, BiFTA-DR, WCA) with standard residual adapters.
- Overclaimed “Difficulty-Scaling Rule”: the evidence is limited to three datasets, with a substantial gain only on CUB.
- Weak statistical reliability: the reported mean ± std is based on only two runs, which is insufficient for a robust estimate of variance.
- This article is overly reliant on AI and has a lot of hallucinations. For instance, the author cites the ABS method, which should stand for Attention Based Selection, but mistakenly uses attention guided bounding box selection.
Questions for authors
- Could you provide an ablation that more clearly isolates the contribution of the dual residual adapters from ABS, BiFTA-DR, and WCA?
- Could you provide additional evidence to support the proposed “Difficulty-Scaling Rule” beyond the three evaluated datasets?
- How many independent runs were used to compute the reported mean ± std? Could you report results over more runs?
2 comments
This paper contains a large amount of AI-generated content and AI hallucinations, so I do not believe it meets ICLR’s submission standards. The authors’ response merely removed everything I had raised concerns about, which does not address my concern. I have therefore decided to maintain my score.
ABS expansion corrected, unsupported results removed and named in the AI Use Statement, novelty narrowed to residual calibration within ABS+WCA pending the global-feature control, “Difficulty-Scaling Rule” replaced by the observed gains, “± std” replaced by means with ranges (three draws per dataset planned), and component ablations ready to post if they finish.
Thank you for the review. We agree with several of your criticisms and have revised the paper to address them. Please also see our general response.
W4 (over-reliance on AI, e.g. the ABS expansion). You are right. ABS stands for Attention-Based Selection, not "Attention-guided Bounding-box Selection". The general response lists every error we found, including results that had no experiment record, and all of them have been removed. We checked each method description against the original papers and the public code, and the AI Use Statement now names these errors.
W1 (limited novelty). We agree that each component has a close precedent, and the contributions section now says so explicitly, citing CLIP-Adapter, Tip-Adapter and CLIP's contrastive loss. What remains is a narrower claim, a residual calibration of region and description embeddings inside an ABS+WCA pipeline. As Reviewer BvN7 points out, whether that is distinctive depends on the global-feature control. We have implemented it and will report it if it finishes during the discussion.
W2 / Q2 (the "Difficulty-Scaling Rule"). We agree that this was overclaimed and have removed it. The paper now only reports what we observed on three benchmarks, namely that the adapters add 0.33, 0.99 and 19.12 points over zero-shot ABS+WCA, and states clearly that three data points cannot establish a relationship (Section 4.2). We have no results on further datasets.
W3 / Q3 (only two runs). That is correct. Pets and CUB each have two runs, which differ in the random draw of training images, and ImageNet-100 has one. We have removed the "± std" and now report means with ranges (CUB 79.98 to 80.60, Pets 93.00 to 93.54), and Appendix C explains how the draws were made. More runs require retraining on our cached features, and we plan at least three draws per dataset for the final version.
Q1 (an ablation separating the adapters from ABS, BiFTA-DR and WCA). Here is what we can show today. Region matching adds 5.15 points zero-shot on CUB (ABS+WCA vs CLIP), and BiFTA-DR adds 2.80 points on global features. The adapter step also changes the descriptions, but 96.3% of the CUB descriptions it uses are already in the zero-shot set. Running ABS+WCA with BiFTA-DR and no adapters, and running with only Av or only At switched on at test time, needs only inference with the saved checkpoints. That code is ready, and we will post the results here if they complete.