- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes HSNTF for neural tensor factorization, whose core module, the Hamiltonian Singular Field (HSF), refines each tensor element by assembling per-mode embeddings into a joint state z and generating all mode updates from a single shared scalar Hamiltonian, so that the mixed curvature blocks of the field Jacobian encode how a perturbation in one mode first-order affects another under a unified latent geometry, yielding context-adaptive representations read out through mode projections plus a Tucker core. Contributions include context-conditioned dynamic refinement, this geometric organization of cross-mode dynamics, and an inductive-bias analysis; validation on five real tensors shows HSNTF ranking first in 20/21 dataset, alongside structural ablations, mechanism tests, and applicability-boundary studies.
Critical strengths
- The paper formulates the refinement stage as a Hamiltonian dynamical system and introduces a single auxiliary state together with an ordered partition update. This is consequential because it provides a structurally grounded alternative to conventional low-rank regularization for modeling tensor mode coupling.
- The paper goes beyond reporting reconstruction errors by checking the consistency between the mixed curvature operator and numerical differentiation, and by evaluating the method under controlled synthetic conditions such as varying noise, supervision levels, and structural mismatch.
Critical weaknesses
- The paper formulates the refinement process as Hamiltonian structured refinement, introducing a single auxiliary state and an ordered partition update to enable cross-mode information propagation. While this formulation provides an interesting structural interpretation, the necessity of the Hamiltonian structure itself has not been convincingly demonstrated. Specifically, the current ablation in Fig. 3 mainly shows that the auxiliary state participates in information propagation, but it does not rule out the possibility that a non-Hamiltonian refinement module with comparable capacity could achieve similar or even better performance. Without comparing against non-Hamiltonian alternatives—such as a standard neural ODE, a residual MLP-based refinement module, or a volume-preserving but non-Hamiltonian dynamics—it remains unclear whether the Hamiltonian formulation provides unique advantages beyond serving as a structural packaging.
- The specific value of K refinement steps used in the final model design should be clarified. Additionally, ablation studies with different values of K are needed to verify the setting at which the model achieves optimal performance or stabilizes. A sensitivity analysis for K would help justify the chosen hyperparameter.
Questions for authors
-
Could the authors clarify the specific value of K refinement steps used in the final model design? Additionally, have ablation studies been conducted with different values of K to verify at which setting the model achieves optimal performance or stabilizes?
-
In Figure 6 of the supplementary material, does the solid blue line represent the proposed model?