- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper studies how the choice of one-dimensional projection directions affects sliced latent regularization toward an isotropic Gaussian distribution. The authors consider autoencoder and JEPA-style training, with either sliced Wasserstein-2 (WS2) or Epps-Pulley (EP) as the latent regularizer. They compare independently sampled random directions with a deterministic rotating orthonormal frame. They further propose augmenting either base direction set with radial-adaptive directions obtained by selecting minibatch latent vectors whose squared norms are atypical under the target chi-square distribution.
The learned representations are evaluated using the average per-direction Kolmogorov-Smirnov discrepancy under two direction banks: uniformly random directions and directions obtained by normalizing held-out latent representations. The main empirical findings are that random-direction evaluation can report substantially smaller discrepancies than latent-derived evaluation, radial-adaptive augmentation reduces the mean latent-direction KS discrepancy across the tested configurations, and deterministic rotation alone does not consistently outperform random directions.
Critical strengths
The paper examines an important but often overlooked aspect of sliced latent regularization: the choice of projection directions. The proposed radial-adaptive augmentation is simple, introduces no learned parameters or inner optimization, and can be combined with both random and rotating base directions. The experimental design is generally careful: comparisons use matched slice budgets, a factorial construction, ten paired training seeds, two regularization losses, two learning objectives, and both random- and latent-direction evaluation. The authors additionally provide sample-disjoint controls and appropriately acknowledge that deterministic rotation is not consistently superior to random sampling. The radial-adaptive method lowers mean latent-direction KS discrepancy in all 16 matched comparisons, indicating a consistent improvement in matching the specified isotropic Gaussian target.
Critical weaknesses
The paper’s presentation is difficult to follow because it introduces several direction schedules, training losses, evaluation metrics, and learning objectives without clearly prioritizing the central contribution. More importantly, the motivation for the deterministic rotation schedule is weak: the golden-ratio-based angle construction is largely heuristic, receives no sensitivity analysis, and does not produce a consistent advantage over random directions. The radial-adaptive component also lacks essential ablations for , thresholding, and unranked latent-derived directions, making it unclear whether radial atypicality itself is important or whether any latent-derived augmentation would provide similar benefits. Comparisons with closely related data-informed methods, such as max-sliced and random-path sliced Wasserstein, are also missing. Finally, the evaluation primarily demonstrates improved Gaussian-target matching on MNIST and ImageNet-100; it does not establish meaningful improvements in reconstruction, representation quality, or downstream performance, and the linear probes are used only as diagnostics against complete collapse. These limitations leave the practical significance and generality of the method uncertain.
Questions for authors
Questions for the Authors
-
Clarification of the overall objective: Could the authors provide an earlier and more intuitive explanation of what constitutes a “slice” and clearly separate the roles of the task loss, WS2 or EP regularization, KS evaluation, and linear-probe cross-entropy? The current presentation makes it difficult to determine which quantities are optimized and which are used only for evaluation.
-
Motivation for the rotation schedule: What theoretical or empirical evidence motivates the specific golden-ratio-based angle schedule, the interval , and the round-robin coordinate pairings? Equidistribution of the scalar phase does not necessarily imply uniform or low-discrepancy coverage of the unit sphere by the resulting orthogonal frames.
-
Monte Carlo variation: Can the authors quantify the Monte Carlo variation introduced by independently sampled random directions and demonstrate that the deterministic rotating schedule actually reduces the variance of the sliced-loss or gradient estimator? The current paper states this motivation but does not directly measure it.
-
Isolating the effect of rotation: Rand-D and Rot-D differ in orthogonality, randomness, temporal dependence, and directional coverage. How can the observed differences be attributed specifically to rotation? Could the authors include fixed-orthogonal and freshly sampled Haar-random orthogonal baselines to isolate these factors?
-
Comparison with existing direction-selection methods: Why are there no experimental comparisons with established alternatives such as Max-Sliced Wasserstein, Distributional Sliced-Wasserstein, and Random-Path Sliced Wasserstein? Random-Path Sliced Wasserstein appears especially relevant because it also constructs optimization-free, data-dependent projection directions. PCA/eigenvector directions and prior parameterized orthogonal-projection methods would also be natural baselines.
-
Evaluation-direction dependence: In the primary test-latent evaluation, the same held-out representations define the direction bank and supply the samples being projected. In particular, every sample is projected onto its own normalized direction, resulting in its norm. Since the proposed adaptive method explicitly targets radial atypicality, to what extent does this evaluation favor the proposed method? Could the authors make the disjoint-sample evaluation more prominent and include additional independent direction banks or multivariate Gaussianity diagnostics?
-
Practical significance: Does the reduction in latent-direction KS discrepancy produce measurable improvements in reconstruction, downstream representation quality, linear-probe accuracy, or another practically meaningful outcome? Without such evidence, it is unclear why improved agreement with this particular Gaussianity diagnostic is valuable.
-
Experimental generality: Do the conclusions hold under stronger architectures, longer training, full ImageNet, or additional self-supervised learning settings? The current MNIST and ImageNet-100 experiments are useful controlled ablations, but they provide limited evidence of general applicability.
-
Statistical testing: The paper reports many paired hypothesis tests without correction for multiple comparisons. Do the principal conclusions remain statistically supported after an appropriate correction, and can the authors emphasize effect sizes and uncertainty rather than the number of nominally significant comparisons?
-
Relationship to prior orthogonal latent-space methods: Could the authors more clearly discuss how the rotating orthogonal frame differs from prior methods that construct or learn orthogonal projection directions in latent space? This comparison is necessary to clarify the novelty of the structured-rotation component.
2 comments
Follow-up: Design Justification and Remaining Concerns
Thank you for the detailed response and the additional clarification of the contributions. The disjoint-sample and Gaussian-reference controls strengthen the diagnostic finding, and the matched-budget results support the augmentation relative to random augmentation. I also appreciate the statistical correction and understand that downstream superiority is outside the central claim. However, several concerns remain:
- Presentation and organization. Although the response clarifies the roles of the objectives and diagnostics, the manuscript remains difficult to follow. An early overview of the complete training procedure would help. The presentation should prioritize the directional diagnostic finding and adaptive augmentation, while giving the exploratory rotation study an appropriate supporting role.
- Justification of rotation. The response acknowledges that the angle schedule is heuristic, scalar-phase equidistribution does not establish spherical coverage, and reduced loss or gradient-estimator variance has not been demonstrated. Furthermore, Rand-D versus Rot-D changes orthogonality and temporal dependence alongside rotation. Framing this construction as a baseline appropriately limits the claims, but the rationale for the particular golden-ratio schedule and angle interval remains insufficiently supported.
- Validation of radial selection. The strongest unresolved issue is the missing unranked latent-derived augmentation control. The reported improvements establish benefits over random augmentation, but do not determine whether radial-atypicality ranking adds value beyond selecting latent-derived directions generally. Sensitivity to the fixed budget and comparisons with closely related methods, particularly Random-Path Sliced Wasserstein, would further clarify the contribution’s robustness and added value.
I recognize the supported empirical findings and the authors’ candid clarification of their limitations. Nevertheless, the distinctive benefit of the proposed radial-selection rule remains insufficiently established, and the presentation still obscures the central contribution. I therefore maintain my original assessment.
Reviewer zmqS: Contribution Focus, Experimental Controls, and Statistical Evidence
We thank the reviewer for recognizing the matched design, disjoint controls, and consistent mean adaptive improvements. The presentation should prioritize the directional finding and adaptation.
Rotation showed no consistent advantage, whereas adaptation helps with either base schedule. This motivated emphasizing adaptation rather than extending the schedule study. Limited space explains that presentation choice, but does not replace missing controls.
Q1. Objectives and diagnostics. A slice is a unit direction onto which latent vectors are projected. Encoder training combines a task loss with WS2 or EP regularization toward standard Gaussian projections. The task loss is reconstruction MSE for AE or bidirectional prediction loss for JEPA. KS is evaluation only. A linear classifier is subsequently fitted by cross-entropy on frozen encoder outputs. These roles should be distinguished earlier.
Q2–Q4 and Q10. Rotation, variance, and novelty. The angle schedule is heuristic. Scalar phase equidistribution does not establish uniform or low-discrepancy sphere coverage. We have not demonstrated reduced loss or gradient-estimator variance. Removing fresh directional sampling alone does not establish variance reduction.
Rand-D versus Rot-D also changes orthogonality and temporal dependence, so it cannot isolate rotation causally. Fixed orthogonal and freshly sampled orthogonal frames would be appropriate controls. This schedule is a tested baseline, not universally superior. We do not claim novelty for orthogonal projections generally, an optimal schedule, or proven variance reduction.
Q5. Related methods and controls. Random-path sliced Wasserstein is particularly relevant as an optimization-free, data-dependent construction. Our method selects normalized minibatch vectors by radial atypicality relative to the target, but this difference does not establish superiority. Max-sliced, distributional, PCA-based, and other orthogonal constructions are also relevant comparisons. The present evidence is against matched random augmentation. Unranked latent-derived augmentation remains the most direct missing training control for isolating radial ranking. The experiments use K=8 without thresholding, so sensitivity to these choices remains unresolved.
Q6. Evaluation dependence. Appendix C splits held-out representations into two subsets. One supplies directions and the other projected observations, then their roles are exchanged. The directional gap remains positive for all 480 models, and all 16 mean adaptive improvements persist. Isotropic Gaussian reference controls produce gaps close to zero.
The paper's direct self-projection bound applies to removing the source observation from a fixed projection, not to all dependence from constructing a direction bank. Disjoint controls address sample reuse, but not the relationship between training and evaluation direction families. Finite projection tests also cannot certify full multivariate Gaussianity. Moment-matched Gaussian controls show that mean and covariance mismatch can explain substantial gaps.
Q7–Q8. Practical significance and generality. The recommendation applies when isotropic Gaussian matching is already a design objective. The augmentation improves latent-direction agreement without additional learned parameters or inner optimization, but does not establish downstream superiority.
Detailed comparisons of saved reconstruction and probe results, not included in the submitted paper, show mixed task effects, including lower probe accuracy despite improved latent-direction KS. Aggregate probe ranges are reported, but not these detailed comparisons. Above-chance accuracy indicates retained class information, not competitive SSL or the absence of partial collapse. Stronger architectures, longer training, and additional settings are needed to establish generality. Whether another target distribution better serves a downstream task is a separate question from how well the selected target is realized.
Q9. Statistical evidence. An additional Holm correction across the 16 principal adaptive comparisons retains 15 significant differences at family-wise 0.05, with adjusted p=0.03125, but not at family-wise 0.01. MNIST AE with WS2 and a rotating base has a lower mean but is not significant. This correction concerns those 16 comparisons, not every test in the paper.
Relative reductions in mean test-latent KS range from approximately 2.9% to 28.0% on MNIST and 17.6% to 53.1% on ImageNet-100. All 16 mean improvements also persist in disjoint evaluation, but a residual directional gap remains. Effect sizes and seed variability should accompany significance tests. The evidence supports improvement in the tested settings, not complete matching or universal downstream benefit.