- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2(+1)
- Soundness
- 2(+1)
Read review
Paper summary
The authors raise the question of whether the average kNN distance of an imagined latent state to the world model's training latents predicts recursive rollout failure in future steps. They define failure as the rollout RMSE at t+5 exceeding the 80th percentile. The test is whether kNN distance raises AUROC over a baseline of rollout position, current one-step prediction error, and latent norm.
They open the paper with two claims:
- Local support is forward-looking beyond the current error and
- Diagnostic transfer does not imply intervention transfer
Critical strengths
- Multi-Seed controls for the WM
- Honest reporting: The authors report issues and limitations honestly
- Supplementary code is reproducible
- The paper's findings can be useful. Validating a reliability score separately from the control response built on it is sensible, practical evidence
Critical weaknesses
- MW1: The baseline's "current one-step error" is computed from the true state at each step, not from the imagined rollout. In HalfCeetah, it is uniformative on its own: standalone AUROC. The HalfCeetah baseline (AUROC$ \sim $ 0.6) is therefore mostly rollout position ( $\sim $0.57). The current recursive rollout error, the natural sign that the model is "already struggling," sits in the same rollout table but is never used as a predictor. It is an oracle, exactly like the one-step error the paper includes to make the test conservative. Without it, the papers' first claim that kNN adds information beyond the current error remains untested. Please add the current recursive error to the baseline and report the KNN increment with and without Mahalanobis distance and disagreement. This should be done for every seed and extension (please refer to Q1).
- MW2: Section 5.2 says the horizon sweep "directly tests" whether the kNN effect is merely contemporaneous. It cannot. A rollout that has already drifted away from the training data tends to stay there, so a signal that only measures current drift would also improve prediction at every future offset. The HalfCeetah gains are consistent with a simpler explanation: They barely change with the offset. To show that kNN anticipates failure, the authors could either control for the rollout's current error or predict how much the error will grow between now and the next step, rather than its level. Or test whether kNN identifies which states that have not yet failed will fail. As this section is the main evidence for the paper's central claim, it belongs in the main text, not only in the appendix.
- MW3: That imagined states far from the training data later fail to restate the compounding error and model-exploitation premise that the introduction treats as known.
- MW4: The introduction never specifies what a planner should do upon receiving a warning, and the study then tests a single, fixed additive penalty. "Diagnosis does not imply intervention" is therefore shown for a single response family.
- MW5: The main text does not carry the evidence. It has two figures and two tables. Section 5.3's 160/160 counts and section 5.4's conclusions cite no table or appendix. Additionally, 5.4 reports no Number. The world model design is uncited, the classifier behind every AUROC is never named, and the reward model and planner appear in Section 3.4 without any motivation (Details are unmentioned; from this reviewer's perspective, they are referred to in the appendix). The fixed-horizon setting, the 80th-percentile threshold $ \lambda = 0.5 $, 90th-percentile scale matching, and everything else are simply introduced and not supported by any cited scientific backing or ablation study.
- MW6: The Authors' names and numbers are carefully scoped to prevent overclaim. This, however, generally limits the interpretation of results at other parts, for example, the Hopper/HalfCeetah gap. The authors call the gap but never explain it, even though the evidence (MW1) could do so.
Questions for authors
- Q1: Please report kNN and Baseline + current recursive rollout error, with and without Mahalanobis and disagreement. Please do so for all seeds and extensions, and clarify if the "beyond current error" claim survives.
- Q2: Could the authors please state the classifier that produced the reported AUROCs? It should be stated, and a flexible baseline added (gradient boosting or one-hot rollout position) so that kNN cannot compensate for a misspecified linear model.
- Q3: How does the horizon sweep separate anticipation from persistence? Predicting the onset of failure among states whose current recursive error is still below the threshold would directly test the paper's own motivation.
- Q4: How sensitive are the results to the 80th percentile threshold, k, and $\lambda $ under the corrected support reference?