- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper examines the assumption in world-model planning that more sampling steps yield more accurate imagined futures. It finds that the learned models are over-dispersed and that coarse few-step solvers happen to offset this bias, so the error of the planner’s statistic grows as the solver converges. Based on this, it proposes DARC, which uses simulator reset-and-replay as the reference, applies a mean-preserving dispersion scaling to value samples, and fits one scalar per task, solver budget and statistic. On 135 latent world models, it reduces the statistic error by 25% without extra model evaluations. However, the method does not change the selected actions, with no gains in ranking, regret or closed-loop control; it also relies on a simulator with exact state reset, and the accounting behind its headline numbers is unclear. The paper’s value lies more in its diagnosis than in its method.
Critical strengths
(1) It is commonly assumed that more sampling steps make the generative model’s solution more accurate, the imagined futures more reliable, and planning better. The authors find that this can actually get worse, which is a very interesting finding, somewhat like “a person who tends to exaggerate seems more reliable when speaking vaguely; the more clearly they speak, the more obvious the exaggeration becomes.”
(2) The paper shows that the error of a coarse solver may be masking the defects of the model itself, and with a simple scaling it calibrates the planner’s statistic to the true level.
Critical weaknesses
(1) The paper uses many coined terms (“three-law formulation”, “cells”, “families”, “predicted nulls”, etc.), and key definitions are placed in the appendix, so repeated reading is needed to understand what is fitted and what each percentage refers to.
(2) The method itself offers limited novelty: it essentially adds a temperature-like scaling to the dispersion of value samples, fitting one scalar per task, solver budget and statistic. The main contribution is the diagnostic analysis rather than the method.
Minor suggestion: Find a setting where readout calibration actually changes the selected action (e.g., risk-constrained planning with a threshold on the failure probability) to demonstrate the value of the method; otherwise, the paper would be better repositioned as an analysis paper.
Questions for authors
pls see weaknesses.