- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper addresses a real and under-explored problem — continuous-output domain adaptation — and the central idea of using pretrained text encoders as a complementary representation of numerical attributes isnovel and well-motivated. The theory-to-method structure is clean, and the authors are commendably honest about what their analysis does and does not guarantee (e.g., they explicitly state that similarity is "not a calibrated probability" and that the analysis "does not guarantee ... the benefit of the additional RI regularizer"). The empirical gains are substantial on MPI3D and BIWI.
Critical strengths
1 Rigorous and honest theory. The analysis carefully separates the "information" question (Proposition 1, text adds no information given full V) from the "representation/function-class" question (a restricted regressor can still benefit). This distinction is conceptually valuable and the authors resist overclaiming throughout.
2 Clean theory-to-method mapping. Each design choice (retain visual features, fuse rather than replace; attend to pseudo-label reliability; jointly supervise modality-specific and fusion branches) is explicitly traced to a theoretical result.
Critical weaknesses
-
Baseline and comparison fairness / contribution isolation.
The authors themselves note (Sec. 5.2) that the benchmark comparisons "do not separately identify the contributions of pretrained features, prototype initialization, or an individual term in the risk bound." This is a significant concern: TCC combines (a) frozen pretrained visual/text encoders, (b) prototype-based target initialization, (c) three-branch supervision, and (d) the RI-Loss regularizer. It is unclear how much of the large MPI3D/BIWI gain comes from the core "text-assisted re-encoding" idea versus, e.g., the pretrained features or the pseudo-label refinement procedure. A stronger ablation would disentangle these (e.g., a version using only pretrained visual features with the same refinement loop but no text branch; a version without the RI term but with all three branches).
-
Practical applicability and reliance on a frozen text encoder.
The method depends on the availability of a pretrained text encoder that produces Lipschitz-continuous embeddings w.r.t. numerical values (assumed in Sec. 3). The authors acknowledge that "nearby values may tokenize differently." For real regression tasks (depth, head pose, etc.) where values are dense and high-precision, the sensitivity of the text embedding to small numerical perturbations is a central practical risk. I would like a more explicit characterization of how sensitive the final predictions are to tokenization/precision of the numeric prompts, and whether the empirical gains persist when values are not coarsely quantized.
-
Weakness of the theory-method link for the RI term.
The RI-Loss (from Wang et al., 2026) is imported and the authors candidly admit the analysis "neither ... guarantees the benefit of the additional RI regularizer." Given that the RI term is a nontrivial component of the method, and its statistical scope is only briefly discussed (Appendix A.7), the justification for this specific choice feels under-supported. Either provide a stronger argument, or clearly position it as an empirical engineering choice with an ablation isolating its contribution.
-
Limited scope of datasets / task diversity.
The evaluation covers three synthetic/semi-synthetic or small-scale benchmarks (dSprites, MPI3D, BIWI). The introduction motivates with depth estimation and head-pose prediction, yet no large-scale real regression benchmark is tested. Given the framing, a real-world regression task would substantially strengthen the paper's claim of practical relevance.
Questions for authors
Please see the weaknesses.