- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies the reconstruction-forecasting tradeoff in latent dynamical models and argues that it mainly arises from forcing a single latent representation to serve both objectives. The authors propose a carrier–residual decoupling framework, where a wide carrier is optimized for reconstruction and a narrow residual code is used for forecasting, and evaluate it on several synthetic dynamical systems with different forecasting heads and multi-task optimization baselines.
Critical strengths
- The paper identifies a relevant issue in latent dynamical modeling and gives a simple intuition for why reconstruction and forecasting objectives may interfere.
- The authors evaluate several forecasting heads, multi-task optimization methods, noise settings, and multiple dynamical systems.
- Parameter counts and training details are reported relatively clearly.
Critical weaknesses
- Major concerns about the theoretical analysis. Proposition 1 claims that the reconstruction-optimal projection is not even a stationary point of the prediction objective under a non-commutativity condition, but the provided proof mainly compares a small set of alternative projections and does not establish the claimed first-order result. The nonlinear corollary further makes a strong leap from a varying Jacobian to generic incompatibility of the optimal subspaces.
- Latent capacity is not really controlled by parameter matching. The proposed approach explicitly gives reconstruction a larger j-dimensional carrier while coupled baselines operate through a smaller k-dimensional bottleneck. Increasing hidden width to match parameter count does not remove this difference in representational bottleneck.
- The proposed method is not convincingly separated from a much simpler baseline. The recon-only wide-latent Frozen_j baseline achieves nearly identical reconstruction and forecasting performance to the full decoupled method in many settings. The multi-horizon results make this especially apparent, where Frozen_j and Decoupled are almost indistinguishable across several systems.
Questions for authors
- Could the authors provide a complete derivation showing that the reconstruction-optimal projection is not stationary, rather than only showing that another projection can achieve lower prediction loss?
- Why is the carrier–residual pipeline necessary when Frozen_j already obtains almost identical results in the ablation and multi-horizon experiments?