- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper can be regarded as a follow-up to LeJEPA. It points out that the random projection directions adopted by LeJEPA may not sufficiently capture subtler collapse. The authors adopt spectral directions to replace the original choice in LeJEPA, and further support their claim through both experimental and theoretical analyses.
Critical strengths
The design is well-motivated and the whole paper is easy to follow. The supporting evidence, including Theorem 1 and Figure 3, explains and verifies how random projections dilute localized variance errors. The authors also provide a theoretical justification for their choice: Theorem 2 shows that the covariance eigenframe maximizes the average scale discrepancy among complete orthogonal frames. They also conduct targeted ablations to directly examine the contribution of the eigenframe.
Critical weaknesses
The mechanistic explanation of the downstream benefit remains incomplete. I have a concern about the motivation: preserving variation across all representation directions does not by itself explain why downstream tasks should benefit. Is there any support to connect them? I know section D.4 provides useful backbone diagnostics. However, the training constraint is applied after the projector, leaving an indirect connection between the proposed regularization and the geometry and task-relevant information retained by the backbone.
The contribution of view averaging is not independently evaluated. section B.3 explains the decomposition, but the direction ablations retain view averaging and Table S4 examines other design choices. A controlled comparison with per-view matching would help clarify its contribution. The use of view averaging is reasonably motivated, but its contribution has not been isolated through a dedicated ablation.
Questions for authors
Could the authors disentangle the computational savings due to view averaging and the smaller projection budget from the additional overhead of covariance construction and eigendecomposition? The overall costs are reported, but the contributions of these components remain unclear. This is just a suggestion to make this paper more soild.
Overall, I think this paper is well-motivated. It has provided me with new insights and understanding, and the improvements demonstrate the effectiveness of their design. Hence, I have a positive view of this work, even though the connection between their design choices and downstream performance remains indirect.
Final Assessment
Thank you for your response. I'm very familiar with this topic, and I believe there are something new from the paper, therefore I keep my positive assessmemt. Even though this is only a minor refinement, I don't think ICLR only accepts papers that fundamentally change how the field thinks about a problem.