- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper tracks frozen representations across pretraining checkpoints and observes that MAE/SimMIM performance on several appearance shifts peaks before ID performance and subsequently declines. HyGDL combines AdaIN perturbations, EMA self-distillation, minibatch cross-view SVD projection, and residual-conditioned reconstruction. It improves average PACS performance and mitigates late-stage deterioration on ImageNet-Sty and ImageNet-Sketch.
Critical strengths
-
a clear and testable empirical observation: evaluation every 200 epochs reveals changes hidden by final-checkpoint reporting. Three runs and two generative SSL objectives provide replication evidence
-
good performance: HyGDL reaches 58.15±0.33 average accuracy on PACS, compared with reproduced DisMAE at 53.74 and MS-UDG at 54.96.
Critical weaknesses
-
In the main DomainNet protocol, 29.37±0.29 is only slightly above MS-UDG's 29.16, while HyGDL is worse on Infograph and Quickdraw; MS-UDG variability is not reported. In reverse transfer, HyGDL's 26.14 trails DARLING's 29.99 and SimCLR v2's 28.59. The acknowledged asymmetry limits claims of broadly improved domain generalization and motivates investigating where AdaIN perturbations may fail to preserve useful semantics.
-
Please supplement the representation analysis with visualizations across training checkpoints and decomposition components. Using a fixed sample set, color features by semantic class and style/domain at early, peak-OOD, and final checkpoints, and compare the original, stable, and residual representations.
-
Please specify the backbone, model size, initialization, and result provenance for each method in Table 2. Although DisMAE and MS-UDG are described as reproduced under the same source-only/from-scratch protocol, it remains unclear whether all baselines use the same ViT-Small backbone as HyGDL. Clarify which methods follow Table 6 and provide comparisons with key baselines under matched backbones and comparable training budgets.
Questions for authors
see Weaknesses
============================================
Thanks for authors' responses. I am willing to keep my initial score.
3 comments
The response to W2 and W3
W2
Please supplement the representation analysis with visualizations across training checkpoints and decomposition components. Using a fixed sample set, color features by semantic class and style/domain at early, peak-OOD, and final checkpoints, and compare the original, stable, and residual representations.
Response. We thank the reviewer for this helpful suggestion. We have added checkpoint-wise representation visualizations using a fixed PACS sample set at the early (epoch 200), peak-OOD (epoch 800), and final (epoch 1000) checkpoints. For each checkpoint, we compare the original representation, stable projection, and residual, and visualize the same samples when colored by either semantic class or PACS domain. To make within-checkpoint organization visible, we remove checkpoint-wise mean drift; the original and residual representations use shared PCA bases across checkpoints, while the rank- stable component is shown in its aligned projection coordinates.
The resulting visualization does not reveal a simple semantic--style factorization. Semantic classes remain substantially intermixed across all three components, whereas clear domain-related organization is visible in the original and stable representations. The residual retains non-trivial domain structure, although its two-dimensional projection becomes less visibly separated at later checkpoints.
We view this result as complementary to the linear-probing analysis rather than contradictory to it. The probe shows that the stable component preserves more semantic predictability than the residual ( vs. ), while the visualization shows that this does not imply clean semantic clustering or domain invariance. In particular, the stable projection remains strongly domain-predictive, consistent with our interpretation of "stable" as perturbation-relative rather than as a semantic subspace.
Revision. We have added the new visualization to the Appendix. A.6.1 and revised Sec. 5.5 to make this interpretation explicit.
W3
Please specify the backbone, model size, initialization, and result provenance for each method in Table 2. Although DisMAE and MS-UDG are described as reproduced under the same source-only/from-scratch protocol, it remains unclear whether all baselines use the same ViT-Small backbone as HyGDL. Clarify which methods follow Table 6 and provide comparisons with key baselines under matched backbones and comparable training budgets.
Response. We thank the reviewer for pointing out that the previous version did not make the provenance and comparability of the Table 2 results sufficiently explicit.
We have revised Table 2 to distinguish literature-reported reference results from protocol-matched comparisons. DINO, MAE+BSS, MAE+Sty, DisMAE, and MS-UDG are trained or reproduced by us using the same ViT-Small backbone, source-only/from-scratch initialization, comparable pre-training budget, and downstream evaluation protocol as HyGDL. In contrast, the remaining entries are quoted from the corresponding papers and are not strictly matched: some use different or larger backbones, while others benefit from external ImageNet or MAE pre-training. We therefore retain these results as broader literature references rather than treating them as controlled comparisons.
To make this distinction explicit, we additionally provide a protocol/provenance table in Appendix Sec. A2.6 reporting the backbone, initialization, result source, and whether each method follows our matched protocol. Table 6 summarizes the training and evaluation configuration for the protocol-matched methods.
Under this controlled setting, HyGDL achieves on PACS, compared with for DisMAE and for MS-UDG. On DomainNet, HyGDL obtains , compared with and , respectively; we therefore characterize the DomainNet result as comparable to MS-UDG rather than as a meaningful improvement.
Revision. We have revised the corresponding discussion so that claims of improvement are based on the protocol-matched comparisons, while literature-reported methods with different model capacity or external pre-training are used only for contextual reference.
Dear Reviewer,
Thank you again for your constructive feedback. We have addressed your questions and added the requested analyses in our rebuttal. As the discussion period is approaching its end, we would greatly appreciate it if you could take a brief look at our responses when convenient and let us know if any concerns remain.
Thank you for your time and consideration.
We thank the reviewer for the careful reading and constructive feedback. We appreciate the positive assessment of the observation and performance, and respond to each concern below.
W1
Response. We thank the reviewer for highlighting this limitation.
Under the main protocol, HyGDL achieves 29.37±0.29 average accuracy, compared with 29.16 for our protocol-matched MS-UDG reproduction. Since variability is unavailable for MS-UDG and the average difference is only 0.21 points, we do not interpret this gap as statistically meaningful. The per-domain results are also heterogeneous: HyGDL improves substantially on Clipart (51.49 vs. 47.23) but is lower on Infograph (23.86 vs. 26.12) and Quickdraw (12.76 vs. 14.13).
The reverse-transfer results further expose this asymmetry: HyGDL obtains 26.14, below DARLING (29.99) and SimCLR v2 (28.59). We therefore view the DomainNet results as evidence that HyGDL's benefit is source--target dependent rather than universal.
A plausible explanation is the perturbation model itself. AdaIN primarily varies appearance statistics while preserving spatial content; this inductive bias is well aligned with style- and texture-related shifts, but may be less appropriate for domains such as Infograph and Quickdraw, where the shift can involve abstraction, sparsity, layout, or structural changes that are not well represented by appearance statistics alone.
Revision. We have revised the Sec 5.3 in manuscript to make this limitation explicit and to avoid broad claims of uniformly improved domain generalization. "However, the per-domain and reverse-transfer results reveal clear source. Target asymmetry, suggesting that the benefit is not uniform across shifts and that the current AdaIN-based perturbation may be less effective when domain differences extend beyond appearance statistics."