- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes VarMatch, a variational latent-space framework for semi-supervised domain generalization. During training, the method uses weakly augmented samples to supervise two additional views: an image-level augmented view and a representation-level augmented view generated through variance-scaled stochastic perturbations in the latent space. At test time, the method further adapts to the target distribution through a test-time adaptation strategy while keeping the encoder and classifier parameters frozen.
Critical strengths
Uncertainty-aware latent augmentation: Perturbing latent features based on per-dimension uncertainty is an interesting approach to representation-level augmentation. This allows the magnitude of perturbations to be adaptively controlled based on the estimated uncertainty.
Parameter-free test-time adaptation: The proposed test-time latent transformation and prototype interpolation are insightful approaches for adapting to unseen target distributions without updating the model parameters.
Strong quantitative results: The proposed method achieves substantial improvements over prior works across multiple benchmarks. However, these improvements are obtained with test-time adaptation (TTA), which should be considered when comparing against methods that do not employ TTA.
Critical weaknesses
-
Potential violation of the SSDG evaluation protocol: The main comparisons are against semi-supervised domain generalization (SSDG) methods, which assume that no information from the target distribution is available during training or adaptation. However, the proposed test-time adaptation (TTA) strategy assumes access to the entire unlabeled test set (or a batch of test samples) to estimate the target distribution. This introduces additional information that is unavailable to conventional SSDG methods, making the comparison potentially unfair. Therefore, VarMatch without TTA would be a more appropriate comparison against existing SSDG methods. While Table 2 provides results for the raw model, I suggest reporting results without TTA across all datasets and evaluation settings.
-
Separating the contributions of SSDG and TTA: The proposed TTA strategy is an interesting additional contribution and could be evaluated separately. To establish its effectiveness and ensure a fair comparison, it would be valuable to apply the proposed TTA method to other SSDG baselines and report their performance improvements. This would help distinguish improvements arising from the proposed training framework from those introduced by test-time adaptation.
-
Limited backbone evaluation: The experimental evaluation would be strengthened by including additional modern backbones, such as CLIP ViT and DINO. These experiments would help assess whether the proposed approach generalizes across different feature representations. In particular, comparing against CLIP's strong zero-shot performance would provide a useful reference for evaluating the effectiveness of the proposed method.
Questions for authors
The main concern is the mismatch between the proposed evaluation protocol and the conventional SSDG setting. Existing SSDG methods assume no access to the target distribution, whereas the proposed approach exploits unlabeled target samples through test-time adaptation. This raises concerns about the fairness of the main comparisons. Could the authors clarify how this protocol aligns with the standard SSDG setting? Addressing this issue may require revising the main experimental comparisons to emphasize results without TTA and potentially reconsidering the paper's title to better reflect the actual problem setting.
2 comments
My main concern regarding the SSDG setting versus TTA has been adequately addressed. I encourage the authors to clearly incorporate these results into the revised manuscript. I will maintain my original rating of Weak Accept.
Response to Reviewer jMmY
We thank the reviewer for the thorough review and the helpful comments.
Evaluation protocol and comparison without test-time adaptation- The reviewer is right that the test-time stage uses unlabeled target data, which the SSDG baselines do not. This stage is optional in VarMatch. We therefore report VarMatch without it, i.e., the trained model evaluated directly on the target data with no test-time mechanism, on all benchmarks and label budgets (mean ± SD over three seeds; best baseline from our Tables 1 and 2). It is above the strongest baseline in seven of eight settings and on par with it on miniDomainNet with 5 labels.
We will add this "no TTA" row, which reflects our training stage alone, to Tables 1 and 2.
Training and test-time contributions- We also applied the test-time stage, unchanged, to FixMatch on OfficeHome, trained with the official StyleMatch code base (58.15 without TTA, close to the 57.7 reported for FixMatch in Table 1). In addition, to isolate our training stage, we applied it to a deterministic variant of VarMatch on PACS that removes the variance head, the KL term and the latent view, so that the latent code is a deterministic projection of the backbone features, while keeping every other component. The deterministic variant keeps the latent layer, so the test-time stage runs on it exactly as in VarMatch; FixMatch has no latent layer, so the stage runs on its backbone features.
The test-time stage improves every model, and the variational training adds a further gain on top of it. The results in the table are mean of 3 seeds.
Alignment with the SSDG protocol- Our training follows the standard SSDG protocol: no target data, labeled or unlabeled, is used during training, and the model without the test-time stage is evaluated exactly as the SSDG baselines. The test-time stage is an additional, optional step that uses the unlabeled target set without labels and without updating any parameter, as in test-time adaptation methods such as T3A and LAME. In the revision we will report the two protocols separately in the main tables and state clearly which results use the test-time stage.
Additional backbones and CLIP- The baseline results we compare with are taken from UPCSC (Lee et al., CVPR 2025), and the SSDG methods they cover: StyleMatch (Zhou et al., IJCV 2023), FBC-SA (Galappaththige et al., CVPR 2024) and UPCSC, all use ResNet-18 on these benchmarks, so we followed the same setting to keep the comparison direct and fair. CLIP and DINO are pretrained on very large web data that likely already covers the styles in PACS and OfficeHome, so their zero-shot accuracy does not measure generalization to unseen domains under the few-label setting that SSDG studies.
The title already names test-time adaptation as part of the method.