Q1. Justification of the core hypothesis (Supporting evidence)
The paper argues that domain-dependent covariance structures are a major source of performance degradation under distribution shifts and that whitening mitigates this issue. However, the experiments primarily report classification accuracy without directly examining this hypothesis. Can the authors provide empirical evidence demonstrating that (1) covariance structures differ meaningfully across domains, (2) the proposed method reduces the relevant domain-dependent correlations, and (3) these changes are associated with improved target-domain performance? Such evidence is important for establishing whether the proposed method actually addresses the problem identified in the Introduction.
Q2. Necessity of the two-stage whitening framework and methodological novelty (Clarification and supporting evidence)
The proposed WBN and WCL components are based on existing whitening techniques. What is the specific methodological contribution beyond combining these components within AdaContrast, particularly in relation to prior whitening-based domain adaptation approaches such as DWT (Roy et al., 2019)? Furthermore, the paper argues that feature-level whitening alone is insufficient to regulate global representation geometry. What evidence supports this claim, and why is an additional whitening-based contrastive objective necessary? Although Table 3 demonstrates modest improvements from combining the components, it does not directly establish their claimed complementary mechanisms.
Q3. Preservation of semantic information and limitations of whitening (Supporting evidence)
The paper assumes that whitening suppresses undesirable domain-specific correlations while preserving semantic relationships. However, feature covariance can also reflect class-discriminative structure. How do the authors justify applying whitening without distinguishing between domain-specific and semantically useful correlations? Is there evidence that the proposed whitening operations preserve class separability and improve representation geometry rather than merely changing the feature statistics?
Q4. Consistency between the TTA setting and the evaluation protocol (Clarification)
The paper defines TTA as adaptation during inference and describes an online setting in which target data arrive as a stream. However, Section 3.4 states that the model is trained on target data for 15 epochs. Does this involve repeatedly accessing the same target samples, and when are predictions evaluated relative to adaptation? How is this protocol consistent with online TTA, and are all compared methods evaluated under equivalent target-data access and adaptation budgets? Additionally, does replacing the original BN layers with WBN require retraining the source model, or can the method be directly applied to an existing pretrained source model?
Q5. Inconsistencies and missing details in the implementation (Clarification)
The paper describes ZCA whitening in the Introduction and Conclusion, whereas Section 2.2.2 states that the whitening transformation is computed using Cholesky decomposition following Roy et al. (2019). Which whitening transformation is actually implemented? Since these transformations are not identical, this distinction is important for understanding and reproducing the proposed method. Furthermore, Eq. (12) does not clearly specify how the WCL objective is incorporated into AdaContrast. Does WCL replace the original contrastive loss or introduce an additional objective, and what are the corresponding optimization settings?
Q6. Inconsistencies between reported results and performance claims (Clarification)
The paper claims consistent performance improvements, but Table 4 shows noticeable degradation under several corruption settings, particularly for CoTTA and MEMO. Moreover, the average accuracies described in Section 3.5 do not appear to match the values presented in Table 4. For example, the arithmetic means of the 12 reported MEMO results are approximately 47.4% without whitening and 43.8% with whitening, whereas the text reports an improvement from 43.2% to 44.2%. Can the authors clarify how these averages were calculated and explain these discrepancies? Additionally, what exactly does "+ Whitening" represent for each baseline, and why are only 12 of the 15 corruption types reported?
Q7. Fairness and completeness of baseline comparisons (Clarification)
The main comparisons on VisDA-C and DomainNet-126 largely rely on relatively older methods, despite the availability of more recent SFDA and TTA approaches, including methods discussed in the Introduction. How were the baseline results obtained, and were all methods evaluated under comparable architectures, adaptation protocols, and computational budgets? Can the authors clarify why more recent and directly relevant methods were excluded? This is particularly important given the paper's claims of state-of-the-art performance.
Q8. Statistical reliability and robustness of the reported improvements (Supporting evidence)
The reported improvements over AdaContrast are relatively modest (+1.0 percentage point on VisDA-C and +1.4 percentage points on DomainNet-126), yet the paper provides no information about repeated runs, random seeds, or performance variance. Were the experiments repeated with different seeds, and if so, what are the standard deviations or confidence intervals? Additionally, how sensitive is the method to batch size and covariance estimation settings, particularly given the instability of high-dimensional whitening with limited target samples? These details are important for determining whether the reported gains are reliable and practically meaningful.