- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes coordinatewise precision adaptation for frozen world models under localized sensor corruption. The approach combines calibrated observation-noise scales with exponentially averaged innovation statistics to dynamically adjust the relative importance of observation coordinates during latent-state refinement. The authors evaluate the method on predictive coding world models (PCWM) and Gaussian RSSMs, primarily using Pendulum and Cartpole environments.
Although the paper contains extensive implementation details and statistical comparisons, I have significant concerns about its technical novelty, the limited scope of the experimental evaluation, and the lack of consistent improvements over existing robust filtering techniques
Critical strengths
The problem of adapting frozen world models to changing observation reliability is practically relevant.
The authors provide detailed experimental protocols, including calibration procedures, paired comparisons, and computational-cost analysis.
The proposed approach demonstrates improvements over static precision weighting in the evaluated low-dimensional settings.
Critical weaknesses
- Limited methodological novelty.
The core mechanism is closely related to classical adaptive filtering and innovation covariance matching. The method estimates observation uncertainty from accumulated innovation residuals and uses these estimates to adjust coordinatewise precision during latent-state refinement.
In particular, the authors explicitly acknowledge that their coordinatewise adaptation with λ = 1 reduces to a clipped innovation covariance-matching statistic (Section 3.2).
The introduction of a calibrated diagonal base and a shrinkage exponent appears to be a relatively incremental modification of established adaptive filtering principles.
I find it difficult to identify a substantial new methodological or theoretical contribution that would justify the scope of this work at ICLR.
- The empirical evaluation is restricted to overly simple environments.
The primary experiments are conducted exclusively on two custom low-dimensional environments, Pendulum and Cartpole, with observation dimensions of three and five.
Although the authors evaluate multiple checkpoints and two world-model architectures, these experiments remain within a very narrow class of dynamical systems.
The paper does not demonstrate effectiveness on established, challenging world-model benchmarks, complex visual environments, or downstream control tasks.
Consequently, it is unclear whether the reported improvements generalize to practical world models with substantially more complex observations and dynamics.
- The proposed method does not consistently outperform established robust filtering baselines.
This is a major empirical concern.
According to the primary comparisons in Appendix A.3, the proposed adaptive approaches outperform the selected Huber or inverse-multiquadric (IMQ) baselines in only two out of eight settings. In the remaining six settings, the robust baselines achieve lower prediction errors.
For the coordinatewise approach specifically, only one of the four local-fault settings outperforms the selected robust reference.
Furthermore, the multistep evaluation reports an average improvement of only 0.18% relative to selected robust weighting across the four settings.
These results raise questions about whether the proposed approach provides a meaningful advantage over simpler, established robust estimation methods.
- The visual-input experiment fails to establish the effectiveness of coordinatewise adaptation.
The visual pilot in Section 5.5 and Appendix E is particularly concerning.
When extending the method to 32 × 32 image observations, the validation procedure selects λ = 0, effectively disabling coordinatewise adaptation and recovering static refinement.
The manually examined active configuration also fails to outperform the independently selected static baseline on the aggregate evaluation.
Thus, the only higher-dimensional observation experiment does not provide positive evidence for the main proposed mechanism.
This substantially weakens the paper's broader claims regarding adaptation in frozen world models.
- Limited robustness to different fault types and unclear practical trade-offs.
The method is primarily developed and validated under synthetic variance faults drawn from predefined corruption families.
Appendix A reports that under bias-drift corruption, coordinatewise adaptation produces higher error than static refinement in all four evaluated settings.
This suggests that the mechanism may be specialized to variance changes rather than general sensor corruption.
Moreover, the proposed adaptation introduces additional computational overhead. The reported filtering latency is approximately 1.5–1.6 times that of static refinement in the multistep evaluation.
Given the limited improvements over robust filtering and the absence of demonstrated downstream control benefits, the practical value of this additional complexity remains unclear.
Questions for authors
What is the fundamental methodological contribution beyond established innovation covariance matching and adaptive Kalman filtering?
Why should the proposed method be preferred over Huber or IMQ filtering when these alternatives outperform it in most primary comparisons?
How do the authors explain the failure of validation to select active coordinatewise adaptation in the image-observation experiment?
Can the approach demonstrate meaningful improvements on more representative world-model benchmarks, particularly in closed-loop planning or control?