- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies where to update a model during online test-time adaptation. The proposed AGOE partitions trainable normalization parameters into depth-wise groups and allocates a fixed sum of learning rates among them. It compares each group's proposed update direction with its recent parameter trajectory, then uses a Hedge rule to adjust the allocation for the next batch. AGOE preserves the base adaptation objective and requires one backward pass per batch. Experiments with Tent, DeYO, and ZeroSiam report gains across several batch-size regimes and distribution shifts, particularly where all-layer adaptation is unstable.
Critical strengths
- The paper provides useful evidence that suitable adaptation depths vary across batch-size regimes.
- The method offers a lightweight plug-in for several base adapters.
Critical weaknesses
- The distinction from closely related work is not sufficiently established. GALA [1] is repeatedly described as one-time selection, although the original method selects layers dynamically. A direct comparison with LAW [2], which also studies layer-wise learning-rate adaptation, is also missing. Meanwhile, the idea of adapting learning rates for TTA has also been widely explored [3][4], but the paper fails to properly discuss them.
- The propose method builds on the assumption that more consistent update directions should be encouraged. However, in TTA directional consistency does not establish update usefulness. The accumulated update direction might be noisy due to the unsupervised nature of TTA. Potential beneficial updates that can correct the update direction might be penalized by the method’s design. Existing results do not directly show how the signal distinguishes these potentially helpful cases during distribution transitions.
References:
[1] Sahoo, Sabyasachi, et al. "A layer selection approach to test time adaptation." Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 39. No. 19. 2025.
[2] Park, Junyoung, et al. "Layer-wise auto-weighting for non-stationary test-time adaptation." 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). IEEE, 2024.
[3] Lee, Jae-Hong. "Bayesian weight enhancement with steady-state adaptation for test-time adaptation in dynamic environments." Forty-second International Conference on Machine Learning. 2025.
[4] Shaoran, Lv, Xinyao Li, and Jingjing Li. "CONGA: Confidence-and-Gradient-Aware Learning Rate Schedule for Test Time Adaptation." Forty-third International Conference on Machine Learning.
Questions for authors
- Please clarify the description of GALA and confirm whether its implementation in Tables 2, 3, and 6 follows the original dynamic layer-selection procedure?
- Could the authors explain the methodological differences from LAW and compare the approaches under matched backbone, base objective, stream, and tuning conditions to establish AGOE's additional contribution?
- Eqs. (1) and (3) keep the total learning-rate scale fixed. Could this limit the update efficiency? Could the authors compare the such LR-fixed setting method with settings that allow total LR to change?
- Could the authors analyze whether the proposed mechanism can distinguish beneficial direction changes from noisy updates, and identify cases where consistently aligned updates reinforce errors?