- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates how deterministic views can affect learning despite adding no new statistical information beyond the parent input. For fixed linear views with an additive interface, the authors show that the frame operator preconditions the effective SGD update and characterizes when different view systems follow identical training trajectories. Based on this result, they use the classical Parseval transform to construct a neutral control for deterministic-view ablations. Experiments on EEG and image classification tasks support the theoretical findings and show that changing the frame operator can either help or hurt performance.
Critical strengths
- The theoretical results are insightful and offer a promising perspective for understanding, designing, and refining multi-view learning frameworks.
- The experiments are carefully designed to test the theoretical predictions, with controlled comparisons involving equal frame operators, different spectral structures, and Parsevalization. The results consistently support the theoretical findings across EEG and image classification tasks.
- This paper also examines the conditions under which the proposed equivalence holds or breaks down, including different optimizers, branch nonlinearities, and numerical approximation errors. These analyses help clarify the scope and limitations of the theoretical results.
Critical weaknesses
The paper provides precise and insightful theoretical results within a controlled interface. However, their applicability is subject to restrictive architectural assumptions, which exclude many practical multi-view learning architectures. While these assumptions enable precise theoretical analysis, it remains unclear whether the theoretical results provide useful insights beyond the linear interface, particularly for architectures involving nonlinear view-specific encoders or cross-view interactions.
Questions for authors
-
Theoretical novelty. The connection between linear reparameterization and gradient preconditioning is well established, and Parseval normalization is a classical technique. Could the authors clarify what the main theoretical advances are beyond these existing results, particularly regarding the characterization of frame-operator equivalence and the proposed neutral control?
-
Section 4.4 shows that exact equivalence can break down under AdamW and branchwise nonlinearities. Beyond identifying these boundaries, do the current theoretical analysis or experiments support any diagnostic use of the frame operator or Parseval control in such settings?