- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies two potential limitations of latent world models such as LeWM. First, standard SIGReg encourages latent projections to follow the same isotropic Gaussian distribution, imposing equal target variance in every direction. The authors argue that this may suppress useful directional structure and introduce anchored ellipsoidal SIGReg, which preserves the isotropic constraint while allowing larger variance along a data-dependent principal subspace and smaller variance in the remaining directions. Second, the paper considers cancellation among propagated prediction-error contributions: a model may have a small final rollout error even when large intermediate contributions cancel one another. The proposed hierarchical rollout gap (HGap) constructs hybrid trajectories, decomposes the terminal error into exact contribution terms, and penalizes cancellation between temporal groups. These two regularizers are combined with prediction and multi-start supervision for latent-space planning.
Critical strengths
The paper raises two interesting and relevant questions: whether isotropic Gaussian regularization is unnecessarily restrictive for latent world models, and whether endpoint prediction loss can conceal unstable error propagation through cancellation. The separation between marginal representation geometry and temporal error composition is conceptually useful. HGap’s hybrid-trajectory decomposition is mathematically exact and does not depend on a Jacobian or linear approximation. The paper also provides extensive theoretical derivations, implementation details, and explicit discussion of several limitations. The reported results suggest that the proposed regularization may improve planning performance across the four evaluated environments.
Critical weaknesses
The main weakness is that the empirical validation does not match the complexity of the proposed method. For ellipsoidal SIGReg, the paper does not report the learned covariance spectra, selected subspace dimensions, directional variances, or evidence that the high-variance directions correspond to task-relevant factors. It therefore does not validate the proposed latent-space mechanism. For HGap, the paper provides analytical cancellation examples but no actual cancellation trajectory from the evaluated environments, no evidence that larger HGap predicts planning failure, and no evidence that training reduces cancellation. The component studies also use different protocols, while HGap is bundled with multi-start supervision and additional optimization, preventing clear attribution of the improvement. Moreover, there are no adequate sensitivity studies for important design choices such as (\alpha), (\beta), (\eta), the ellipsoid variances, rank selection, or temporal grouping. Overall, the paper asks valuable questions, but the current experiments do not convincingly validate the proposed mechanisms or establish their generality.
Questions for authors
-
Can the authors report the covariance eigenvalue spectra of the learned embeddings before and after applying ellipsoidal SIGReg, together with the selected rank (k) for each task?
-
What evidence supports the assumption that the leading covariance directions encode task-relevant information rather than visual nuisance factors such as background, lighting, or texture?
-
How was (\alpha=0.1) selected? Please provide a sensitivity study including (\alpha=0), intermediate values, and the purely ellipsoidal setting (\alpha=1).
-
How sensitive are the results to (\sigma_{\parallel}), (\sigma_{\perp}), the stable-rank rule, and the manually chosen lower rank limit of eight?
-
Can the authors compare against an isotropic target with matched total variance and an ellipsoidal target with randomly rotated principal directions? These controls would clarify whether the gain comes from meaningful directional alignment or simply from compressing most latent dimensions.
-
Can the authors provide examples of actual cancellation trajectories from the evaluated environments and visualize the propagated contribution vectors (\Delta_{j,t})?
-
Does HGap correlate with planning failure on held-out trajectories, and does HGap training measurably reduce cancellation compared with the baseline?
-
Can the authors provide a matched factorial ablation under the same training and evaluation protocol: baseline, ellipsoid only, multi-start supervision only, HGap only, ellipsoid plus HGap, and the complete method?
-
Because the ellipsoidal target depends on batch-estimated covariance directions and HGap depends on learned error-cancellation patterns, both mechanisms may be sensitive to initialization and optimization randomness. Can the authors repeat the experiments with multiple independent training seeds to demonstrate that the learned geometry, cancellation reduction, and performance gains are reproducible?
-
HGap is calculated using observed offline action sequences. Does the measured cancellation behavior generalize to planner-selected action sequences, other environments, and latent world-model architectures beyond the evaluated LeWM setting?