- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies training-free multi-domain learning (MDL) with CLIP. Through spectral and Gaussian-geometry analyses of multi-domain CLIP features, the authors make two observations: (1) nuisance-sensitive variations concentrate in spectral-tail directions while dominant class geometry remains domain-dependent; and (2) residual self-domain failures can be complemented by cross-domain evidence, with recoverability reflected in self-domain Gaussian geometry. Building on these findings, they propose STAR, which consists of Subspace Anchor Guidance (SAG) for establishing a reliable self-domain base and CrOss-domain REctification (CORE) for exploiting complementary cross-domain spectral evidence. Experiments on Office-Home, DomainNet, and FMoW-WILDS show consistent gains over training-based MDL baselines while remaining training-free.
Critical strengths
Clean and well-motivated problem. The framing of CLIP-based MDL as a lightweight feature-space refinement task—rather than heavy architectures or complex optimization—is convincing and timely. The spectral/Gaussian perspective offers a fresh lens distinct from prior parameter-allocation and feature-decomposition methods.
Insightful preliminary analyses. The two geometric findings (spectral-tail concentration of nuisance variation, and cross-domain complementarity gated by Gaussian geometry) are nontrivial and directly justify the two-stage design. The analysis-to-method linkage is unusually tight for this line of work.
Training-free and efficient. Achieving parity or superiority over training-based baselines without back-propagation is practically valuable, and the reported computational cost (on the order of minutes, far below model training) strengthens the claim.
Critical weaknesses
Dependence on the number of retained singular directions (K). The framework appears sensitive to the choice of K, which is addressed only in the appendix. Is K selected per-domain or shared? How robust is STAR to sub-optimal K, and is there a principled or automatic selection criterion? This is central to whether the method is truly "training-free" in practice, since hyperparameter tuning is itself a form of fitting.
Comparison with cache-based training-free methods. Related work discusses Tip-Adapter and the cache-based line of training-free adaptation, yet the main results emphasize training-based MDL baselines. A direct, controlled comparison against strong training-free cache-based methods would clarify whether the gains stem from the spectral geometry itself or simply from a more effective support-set statistics usage.
Statistical significance. Standard deviations are reported in the appendix, but the main tables report mean accuracy only. Given that some improvements may be modest, providing confidence intervals or significance tests for the headline gains would strengthen the conclusions.
Generality of the two findings. The geometric analyses are presented on CLIP features. Are the conclusions expected to transfer to other vision-language backbones (e.g., SigLIP, OpenCLIP variants), or are they specific to CLIP's training? An ablation with an alternative backbone would reinforce generality.
Clarity on "recoverability." The notion of Gaussian-geometry-compatible recoverability is central to CORE, but the paper could define more precisely the criterion used to decide when cross-domain rectification is triggered. A clearer formalization would improve reproducibility.
Questions for authors
Please see the weaknesses.
Thank you for the rebuttal.
The authors have addressed most of the mentioned issues. Some issues still existed, such as all the compared methods are all published before 2023 and no theory grounding is proved. And also, domain shift is a key challenge for multi-domain learning, but no analysis about how to avoid it. The subspace learning is fuzzy, as seen in Fig. 3, the novelty is limited.