- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper investigates a failure mode of latent prediction: jointly optimising an encoder and its prediction targets can make prediction easier by suppressing represented variables. It separates context and target gradients, characterises innovation-dependent attenuation under a covariance penalty, and connects retained variance to Euclidean planning distance. Signal-injection and pushing experiments track previously decodable information during training; Cube experiments compare prediction error, contact-variable decodability and planning under regularisation changes and head interventions. The central distinction is between information being recoverable and that information meaningfully influencing the planner’s cost.
Critical strengths
-
The controlled experiments distinguish suppression from failure to acquire information. Section 3.1 starts with decodable independent signals and compares matched training conditions with and without target gradients. The loss of higher-innovation signals repeats across LeWM and DINOv2 heads; nonlinear probes corroborate the principal result. This is substantially stronger evidence for active suppression than finding low endpoint probe accuracy alone. The training trajectories additionally test the predicted ordering of suppression rates.
-
The distinction between decodability and planning-distance sensitivity is experimentally substantive. In Section 3.2, an inverse-dynamics latent supports block decoding at approximately , yet responds weakly to block displacement relative to pusher displacement. The controlled scene perturbations make this distinction concrete rather than inferring geometry from probe scores. Table 2’s paired Cube improvement with target detachment ( percentage points, with a start-bootstrap interval of ) adds practical relevance to the diagnostic argument.
Critical weaknesses
-
Much of the target-gradient mechanism has a close theoretical precedent. Ni et al. (2024), Appendix B, Equations 88 and 101, already identify the conditional-variance contribution to self-prediction error and the additional online-target gradient that can remain nonzero at predictive sufficiency. Consequently, identifying this extra gradient and contrasting it with stop-gradient training is not itself a new mechanism. arXiv The manuscript acknowledges these predecessors, but the clearer increment is the factor-specific attenuation and regularisation analysis, together with the controlled measurements. This limits the weight of the theory as an independently novel contribution, without negating the empirical contribution.
-
The mechanism only partly explains the benchmark planning results. Cube’s measured innovation does not predict which variables are suppressed, and the weak-regulariser runs reach their highest measured retention at the final checkpoint rather than exhibiting the anticipated final-versus-peak decline. Thus, Cube establishes a cross-model loss–retention trade-off, not innovation-ordered temporal forgetting. Moreover, head retraining changes the predictor and representation geometry together, and Section 4 reports planning differences at similar decodability. The intervention therefore establishes an effect of the training choice, but not that contact-information retention mediates the planning gain. These limitations are disclosed appropriately, yet materially restrict the explanation of benchmark control performance.
Questions for authors
-
Beyond the factor-specific rate and regularisation threshold, which aspect of Proposition 1 provides a substantive extension of Ni et al.’s conditional-variance and online-target-gradient analysis?
-
For the paired Cube heads, how do their goal-cost rankings compare when scoring identical encoded simulator outcomes, particularly around contact events? Such a fixed-outcome comparison would help distinguish changes in cost geometry from improvements in rollout prediction, without requiring another training study.
3 comments
Response to Reviewer yXyU (Part 2) - fixed-outcome comparison of goal costs [Q2]
Due to the character limit, we have divided our response into two consecutive comments. This is Part 2 of 2.
Thank you for this suggestion. It separates cost geometry from rollout accuracy without new training, and we have run it.
Design. We used 600 origins: the 300 planning starts, plus 300 states from expert episodes, each within five model steps before the gripper makes or breaks contact. From each restored simulator state we execute 16 candidate action sequences that do not depend on any model: the expert continuation and 15 perturbed copies. Each final frame is encoded once by the frozen backbone that the two heads of a pair share, and each head scores it by its latent distance to its own encoding of the goal. There are six pairs (three weak-regulariser backbones, two initialisations); intervals are 95% bootstrap intervals over origins.
| Kendall between two heads | All origins | Contact change | No contact change |
|---|---|---|---|
| End-to-end vs. stop-gradient | 0.63 | 0.59 | 0.77 |
| Two initialisations, same objective | 0.90 | 0.89 | 0.94 |
| Difference | −0.27 [−0.29, −0.26] | −0.30 [−0.32, −0.28] | −0.17 [−0.20, −0.15] |
The training choice changes the cost geometry, most around contact. On identical encoded outcomes the paired heads disagree far more than two initialisations of one objective, and most where contact changes. Both heads score the same frames through the same backbone, so this cannot come from the predictor.
Neither geometry agrees measurably better with task progress. Rank agreement (Spearman, per origin) with the final cube-to-goal distance is 0.171 for stop-gradient heads and 0.163 end to end (difference +0.008 [−0.010, +0.027]). The interval includes zero at contact changes and elsewhere as well. The stop-gradient heads' top-ranked candidate ends slightly closer to the goal (3.50 against 3.80 cm behind the best candidate; −0.30 [−0.53, −0.09]). With each head's own predicted outcomes the difference disappears (−0.11 [−0.29, +0.07]).
Nor are the stop-gradient rollouts more accurate. Their one-step error is three to four times higher, and across the 20 retrained heads one-step error correlates positively with planning success ().
Conclusion. The paired heads differ in the geometry of the goal cost, mainly around contact. We do not attribute the +5.3-point planning gain to it: a fixed set of 16 candidates does not probe closed-loop search, where the gain may arise. This matches your reading under W2. We will state it in §4 and report the comparison in the appendix.
The push world (§3.2), from existing records. Of the 166 scripted pushes that bring the block to its goal, the encoded true final frame is closer to the goal than the start frame in 83–89% of cases with stop-gradient models, 72–76% end to end and 70–73% with inverse dynamics (three models each). With each model's own rollouts, the figures are 71–78%, 74–79% and 72–73%. Here too, the stop-gradient latent has the more informative cost on true outcomes, and the advantage disappears under the models' own rollouts.
Revised PDF
We have uploaded a revised PDF, with all changes marked in blue. Following your review, it credits Ni et al. (2024, Eqs. 88 and 101) at Prop. 1, adopts your formulation of what the Cube results and the head interventions establish, and adds the fixed-outcome comparison to §4 and Appendix G.
Response to Reviewer yXyU (Part 1) - Ni et al. (2024) [W1, Q1] and what Cube establishes [W2]
Due to the character limit, we have divided our response into two consecutive comments. This is Part 1 of 2.
Thank you for a careful and accurate review. Your summary of the central distinction, between information being recoverable and that information influencing the planner's cost, is the reading we intend.
W1 / Q1 — Prop. 1 and Ni et al. (2024). We agree. The conditional-variance term and the extra online-target gradient at predictive sufficiency are in Ni et al. (Appendix B, Eqs. 88 and 101), and Prop. 1 taken by itself is not a substantive extension. It adds only bookkeeping that the later results use: it names the two residuals (the latent innovation and the sufficiency gap), and it reads the target term as a functional gradient that moves each target embedding towards the average prediction made for it. We will cite Eqs. 88 and 101 at Prop. 1, label it a restatement in our notation, and order the contributions accordingly. The extensions are in the results that follow it:
W2 — what Cube establishes. We agree with both statements and will use your formulation in the abstract, §4 and the discussion: Cube establishes a cross-model loss–retention trade-off, not innovation-ordered temporal forgetting, and the head interventions establish an effect of the training choice on planning, not mediation by contact-information retention. Three new analyses sharpen this without changing it.