- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper aims to address the tendency of predictions to become increasingly concentrated on a small subset of classes during TTA by estimating the mean and standard deviation of each class’s logits and standardizing them accordingly.
Critical strengths
The method is simple and easy to understand. By standardizing class-wise logit distributions, it may help mitigate class-specific prediction biases. Its compatibility with a wide range of TTA methods adds to its practical value. The experiments provide a comprehensive evaluation of its performance, and the reported results support the effectiveness of this simple approach.
Critical weaknesses
The methodological novelty appears limited. Under a fixed bias-free linear classifier and matched statistics, NEO’s feature centering is equivalent to logit centering. Relative to this operation, LAST’s core transformation mainly adds class-wise scaling by estimated standard deviations.
The authors report extensive experimental gains, but the explanation of why the method works remains insufficient. Propositions 3.1 and 3.2 describe elementary properties of entropy, logit scaling, and standardization. However, the paper does not sufficiently connect these properties to the claim that “Overly attenuated logit scales weaken class discrimination and degrade adaptation reliability” (Lines 244–245), or explain how they account for LAST’s effectiveness in mitigating collapse.
I also used an AI agent to statically inspect the provided code and identified a significant inconsistency in the implementation when batch size=1 . Equation (5) estimates the temporal scale using the deviation of the current logits from the previous EMA mean. In contrast, the code directly sets the batch standard deviation to zero when the batch size is one.
if logits.size(0) == 1:
batch_mean = logits.squeeze(0).detach()
batch_std = torch.zeros_like(batch_mean).detach()
The code then applies the EMA update from Equation (4), causing the running standard deviation to decay geometrically, independently of the observed logit fluctuations. This differs substantially from Equation (5) and raises concerns about the reproducibility of the batch-size-one results in Table 3.
Questions for authors
- Could the authors provide a controlled comparison of NEO-style centering, mean subtraction only, standard deviation scaling only, and full LAST? It would be helpful to evaluate these variants under matched settings, both as output post-processing and with their outputs used to compute the adaptation loss. These ablations would help identify which components drive the improvements.
- As discussed in the weaknesses, were the results in Table 3 obtained using the code provided in the supplementary material, or a different implementation? If a different version was used, could the authors provide the corresponding code and configuration?