- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper tries to handle two problem in CTTA: confident predictions are not always trustworthy and bias prediction distributions toward a few dominant classes. To solve this, the authors propose Reliability-Aware Balanced Entropy and Consistency-aware Entropy Exploration. Experiments show that the method achieves competitive overall performance and stable adaptation under continuously evolving target domains.
Critical strengths
- The presentation of the paper is generally clear and easy to follow.
Critical weaknesses
- The biggest issue with this paper is its lack of novelty. Its motivation and the related techniques are already very common in the TTA literature. The reliability of low-entropy samples [1] and the class-collapse problem [2] have already been extensively studied, while consistency based on image augmentation [3] and teacher–student models [4] is also widely used in TTA. Overall, this paper brings me little new information.
- The experimental evaluation is insufficient in scope. The authors do not evaluate the proposed method under several important CTTA settings [5]. I suggest that the authors supplement the paper with experiments under these relevant settings.
[1] Entropy is not Enough for Test-Time Adaptation: From the Perspective of Disentangled Factors. ICLR 2024
[2] NOTE: Robust Continual Test-time Adaptation Against Temporal Correlation. NeurIPS 2022
[3] MEMO: Test Time Robustness via Adaptation and Augmentation. NeurIPS 2022
[4] Continual Test-Time Domain Adaptation. CVPR 2022
[5] Towards Stable Test-time Adaptation in Dynamic Wild World. ICLR 2023
Questions for authors
see weaknesses