The central claim of super-additive synergy is contradicted by the conventional factorial interaction effect.
This is my most serious concern.
In Section 4.3 and Table 2, the authors claim that the feedback pathway and corrective controller exhibit positive super-additive coupling. However, the reported results correspond to negative interaction effects under the standard factorial definition.
For Dog Run, Table 2 reports:
Full model: 0.84
No controller: 0.78
No feedback: 0.68
Neither component: 0.56
Under the standard factorial definition, the interaction effect is obtained by taking the full-model performance, subtracting both single-component performances, and then adding the performance without either component. For Dog Run, this gives negative 0.06 (0.84 minus 0.78 minus 0.68 plus 0.56).
Equivalently, introducing the feedback pathway alone improves performance by 0.22, while introducing the controller alone improves performance by 0.12. Their combined improvement is only 0.28, smaller than the sum of their individual improvements (0.34).
The same calculation gives negative interaction effects for all four tasks:
Dog Run: −0.06
Humanoid Walk: −0.06
Assembly: −0.02
Hand Pose: −0.04
The paper instead defines its synergy index in terms of the performance drop when both components are removed, minus the drops from removing each component separately, normalized by the full-model score. By substitution, this quantity is exactly the negative of the conventional factorial interaction, divided by the full-model score.
Therefore, a positive value of the paper's synergy index is mathematically equivalent to a negative conventional factorial interaction.
This is not an arithmetic error in the proposed index, but a fundamental problem with its interpretation as positive super-additive performance gains.
The results are consistent with partially compensatory effects: when one mechanism is removed, the other can still provide some of the missing functionality. Indeed, Appendix C.4 states that corrections from one mechanism reduce the burden on the other, which is consistent with overlapping or partially substitutable contributions.
Furthermore, the increasing positive S values in Table 11 correspond to increasingly negative normalized interaction effects under the conventional definition.
I acknowledge that the feedback factor also bundles the upward pathway with its associated planning penalty, rather than isolating a single independent operation. However, this does not resolve the sign inconsistency in the reported factorial comparison.
Because super-additive coupling is repeatedly highlighted in the abstract, introduction, and conclusion as a central contribution, this issue directly undermines one of the paper's principal scientific claims.
The claimed single-signal coupling across planning, training, and execution is not established by the mathematical formulation.
The paper repeatedly claims that one cross-timescale disagreement signal operates at three stages: planning, training, and execution.
In Section 3.3, the authors explicitly state:The same functional, evaluated on a transition that actually happened, is an execution residual.
However, the equations do not establish this equivalence.
During planning and training, the proposed disagreement is the KL divergence from the fast-model-conditioned abstract belief (q) to the abstract prior (p). This is a distribution-level quantity defined in the abstract latent space.
In contrast, the corrective controller receives latent-state prediction discrepancies and is optimized using an L2 prediction-error objective.
These quantities differ in both representation space and mathematical definition. The KL disagreement is computed between distributions in the abstract latent space, whereas the execution residual involves differences between fast latent-state representations.
Moreover, while the belief distribution q can provide a direction for updating the abstract prior, the scalar KL divergence alone does not directly specify an action correction.
The paper does not provide a mathematical derivation connecting these quantities, nor does it demonstrate experimentally that the controller directly consumes G or directional information derived from q and p.
Consequently, the existing results may support a useful combination of consistency-regularized planning and residual control. They do not establish the stronger claim that a single directional signal directly drives all three stages.
This distinction is central to assessing the paper's novelty. Without a rigorous connection, the proposed framework appears closer to combining two related but distinct error-handling mechanisms than to the claimed unified single-signal architecture.
Multiple inconsistencies in experimental coverage and quantitative reporting undermine confidence in the evaluation.
Cross-checking the main paper and appendices reveals several concrete discrepancies.
(a) Incomplete DMControl task reporting.
Appendix M, Table 27, claims to report results for all 30 DMControl tasks and supports the statement that HiWM achieves the best performance on 26 out of 30 tasks.
However, the table contains only 24 tasks: 5 easy, 9 medium, and 10 hard.
Furthermore, HiWM achieves the highest reported score on every one of these 24 tasks. The paper also states that the four exceptions are characterized by low-dimensional observations and short effective planning horizons, while all explicitly reported low-dimensional tasks favor HiWM.
The six missing tasks and the identities of the four exceptions must be provided to reconcile these statements and verify the claimed 26/30 result.
(b) Inconsistent baseline evaluation coverage.
Appendix B.3 states that Puppeteer and HWM are evaluated on 12 representative tasks with three seeds, whereas Director is evaluated on 80 tasks with five seeds.
Nevertheless, Table 1 presents aggregate benchmark comparisons across these methods without adequately clarifying whether the results are calculated over identical task sets.
The appendix also generally describes evaluation using five seeds, which is inconsistent with the stated three-seed protocol for these hierarchical baselines.
Without a clearly matched evaluation protocol, the aggregate IQM comparisons and conclusions about hierarchical baselines are difficult to assess fairly.
(c) Contradictory computational-cost reporting.
Appendix P, Table 30, reports HiWM training time as 8–10 days.
However, Appendix Q states that simulation experiments require 8–10 hours per task on a single A100 GPU.
These figures differ by approximately a factor of 24, making the reported computational cost unclear.
(d) Inconsistent real-robot trial counts.
Appendix J specifies 20 trials per method per task across three tasks, with two policy seeds alternated across trials.
Given the three methods reported in the main hardware comparison, the stated protocol accounts for 180 trials in total (three tasks, three methods, and 20 trials per method per task).
However, Appendix Q reports approximately 360 real-robot trials without explaining the additional experiments.
The use of two alternating policy seeds does not itself double the stated number of trials.
(e) Incorrect quantitative statement in Section 4.3.
The text claims that the no-feedback configuration performs worse than TD-MPC2 on three of four representative tasks.
However, Table 2 shows worse performance on only two of the four tasks when compared with the listed TD-MPC2 reference.
Individually, some of these discrepancies could be reporting or transcription errors. Nevertheless, their combined presence makes it difficult to verify several prominent experimental claims, particularly given the emphasis placed on evaluation breadth and robustness.
The algorithm specification leaves critical aspects of execution and belief learning unresolved.
Algorithm 1 contains ambiguities that directly affect reproducibility and the interpretation of the proposed mechanism.
(a) The source of the controller's prediction residual is unclear.
The controller in Section 3.3 is defined using the current fast latent state, a predicted fast latent state, and the reference action.
However, Algorithm 1 does not clearly explain how the predicted state used for online correction is preserved and updated across control steps.
Line 13 initializes a predicted fast state within the planning rollout, while line 28 uses the current and predicted fast states to compute the corrective action.
The paper does not explicitly distinguish the planning-time initialization from a prediction carried over from the previous execution step.
It is therefore unclear how the controller obtains the intended execution-time prediction discrepancy during inference.
This ambiguity does not necessarily imply that the implementation is incorrect, but the required state propagation is missing from the algorithmic specification.
(b) The next abstract state is referenced before it is available.**
Line 27 computes the next fast-state prediction using the next abstract state, although the corresponding environment observation is obtained only after action execution, and the next observed abstract state is encoded in line 35.
If line 27 is intended to use a predicted abstract state rather than an observation-derived state, the notation and execution sequence must be corrected.
As written, the algorithm does not clearly specify a causally executable procedure.
(c) The learning mechanism for the fast-conditioned belief q is insufficiently specified.**
The disagreement regularizer explicitly applies a stop-gradient operation to the fast-conditioned belief (q) before computing the KL divergence against the abstract prior (p). Thus, this regularizer does not directly propagate gradients through q.
However, Equation (4) and Algorithm 1 do not clearly specify an independent learning objective or parameter-sharing mechanism that trains the fast-conditioned belief distribution.
Appendix A.4 introduces cross-level alignment modules, but their precise relationship to the parameterization and optimization of q is not established.
This is particularly consequential because q serves as the central training target for the abstract prior. Its ability to provide informative predictions cannot simply be assumed.
The authors should explicitly specify how q is constructed, which parameters it uses, and through which loss terms those parameters are updated.
These issues concern the functionality of the central mechanism rather than minor implementation details.
The disagreement signal is insufficiently validated as a general reliability measure, and important performance contributions remain entangled.
(a) Cross-timescale agreement does not necessarily imply prediction accuracy.**
Section 4.4 and Appendix F report correlations between imagined disagreement and disagreement recomputed using realized latent states.
These results are useful, but realized disagreement is still a model-relative quantity. It is not equivalent to an independently measured error between a predicted trajectory and the actual environment dynamics.
Two predictors can agree while both making incorrect predictions.
This common-mode failure is particularly relevant here because Equation (1) conditions the fine predictor on the abstract prediction. The two predictors are therefore structurally dependent rather than independent estimators.
Their errors may be correlated, allowing disagreement to remain low even when both predictions are inaccurate.
The paper does not adequately investigate this failure mode or establish the calibration of G against actual future prediction errors.
Consequently, the claim that cross-timescale disagreement acts as a general model-mismatch detector is stronger than what the presented analyses establish.
(b) The exploration bonus is not independently isolated.
Appendix A.5 introduces an exploration objective that adds a positive bonus proportional to disagreement. This constitutes an additional use of the disagreement signal beyond the three mechanisms emphasized in the main paper.
Because disagreement-guided exploration can affect the data distribution and subsequent model quality, it may contribute to the observed performance improvements.
However, the main credit-assignment experiments do not clearly isolate the contribution of this exploration bonus.
The use of positive disagreement during exploration and negative disagreement during planning is not inherently contradictory, since these objectives serve different purposes. Nevertheless, the contribution of exploration should be separated from the proposed planning-training-execution coupling.
(c) Additional simple controls would strengthen the causal attribution.
The evaluation includes a flat backbone with an identical corrective controller, which is a useful comparison.
However, simple alternatives such as observation filtering, noise-augmented training, or online bias estimation would help determine how much of the robustness improvement requires the proposed cross-timescale mechanism.
I do not regard the absence of every possible baseline as a decisive weakness. The more important issue is that several mechanisms remain entangled while the paper makes strong claims about their individual and synergistic contributions.