- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies how strongly visual estimates built from inferred (pseudo-label) assignments should refine a text-anchored classifier during test-time adaptation of CLIP. The proposed method, WAVE, gates each class's visual contribution through two text-anchored assessments, individual evidence assessment (IEA), which scores an image–class assignment by the entropy of its projected class-similarity profile residual against the candidate's text profile, and collective evidence assessment (CEA), which checks whether the assignment-weighted visual centroid still favors its proposed class over competing text classes. The two scores jointly determine a class-specific fusion weight between the text prototype and the visual estimate, and updated statistics feed back into assignments within the batch.
Across 14 datasets and 11 test-distribution settings, WAVE consistently improves over its base solver and alternative configurations of the assessments.
Critical strengths
1. The paper clearly poses the question of how much influence visual evidence should receive and designs a coherent mechanism to answer it. As the authors frame it, assigned mass to a visual proposal measures how much data supports it numerically, but does not establish the semantic basis for using it to revise a class representation, and WAVE answers this with two complementary checks on the individual assignments and their aggregate. The experiments show consistent gains over StatA-hard, the single assessments, and a rerun ADAPT in nearly all evaluated settings.
Critical weaknesses
1. The two assessments can only see what the text can express, but the information adaptation needs most lies outside the text. Both scores are computed from similarity to the frozen text prototypes, so visual information that the text cannot describe never enters the assessment. This is a problem because test-time adaptation exists precisely to add what the text lacks, such as target-domain appearance and visual distinctions the text prototypes do not capture.
Questions for authors
- Robustness to text quality. Since the whole mechanism depends on the text prototypes, it would be useful to see results under different text quality, for example different prompt templates or weaker text encoders, to show how the assessments behave when the text reference degrades.
- More backbones. The evaluation uses a single CLIP backbone (ViT-B/16). Results on more backbones, for example ResNet-50 or other CLIP variants, would show whether the conclusions hold beyond one encoder.
- Combination with other methods. The evidence assessment is proposed as a general rule for controlling visual influence. It would be useful to see it applied on top of other TTA methods that also build visual estimates from pseudo-labels, to show whether the gains transfer beyond the solver used in the paper.