- Rating
- 1(−1)
- Confidence
- 4(+2)
- Informativeness
- 2
- Presentation
- 1(−1)
- Soundness
- 1
Read review
Paper summary
The paper audits the test-time training mechanism in the released Scal3R model. It analyzes the scale invariance of the implemented update and reports that substantial differences in fast weights have little effect on ATE under several interventions on TUM RGB-D and 7-Scenes. It also evaluates window averaging and self-consistency-based selection of the alignment back-end as ways to improve trajectory accuracy.
Critical strengths
-
The audit distinguishes removing the TTT branch from freezing its fast weights, helping separate the branch’s contribution from the benefit of test-time adaptation. Paired comparisons on the same windows and the compute-matched zero control strengthen this analysis.
-
The gradient probes distinguish gradient alignment from update similarity. First-block and full updates produce fast weights differing by 5–16%, despite small differences in ATE (Figure 2 and Section 6.2), providing an interesting observation about the deployed model.
Critical weaknesses
-
The main contribution appears limited to an empirical observation that the tested Scal3R checkpoint is relatively insensitive to several TTT interventions in terms of ATE. The scale-invariance property is inherited from LaCT (Zhang et al., 2025) and Muon (Jordan et al., 2024), as the authors acknowledge. The study does not yet explain why the observed weight changes produce little improvement, or establish when this behavior should be expected. The window-averaging and back-end-selection results offer practical improvements, but provide limited additional insight into test-time adaptation.
-
The interpretation of the ATE results seems stronger than the measurements support. Similar ATE values do not imply similar predicted trajectories, particularly after separate Sim(3) alignment. Tables 1 and 2 measure changes in reconstruction error rather than changes in the predictions themselves. Moreover, the depth evaluation in Appendix G only considers frame duplication, leaving the geometric effects of branch removal, frozen weights, and block subsampling unresolved.
-
The reported 20°–34° weight rotation is estimated using random gradient directions rather than measured during actual scene adaptation (Section 6.3). The rotation after norm restoration depends on the update’s direction relative to the pretrained weights, so its magnitude cannot be established from normalization alone. The measured 5–16% weight differences compare first-block and full updates, which is a different comparison from the change induced by adaptation relative to the pretrained weights.
-
The evaluation provides limited evidence about the long-range memory behavior motivating the study. Most experiments use 300-frame windows from nine indoor sequences, while the 1,200-frame evaluation covers only one sequence (Table 19). These results establish a useful observation in the tested settings, but leave unclear whether the same behavior persists in large-scale scenes where cross-block context may play a more substantial role.
Questions for authors
See weaknesses.