- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper makes the action's contribution to the predicted object change an explicit, state-conditioned operator inside a TD-MPC2 world model. At a fixed physical context the operator is fixed, so an action perturbation changes the pre-normalization prediction by exactly the operator applied to it. A closed-form minimum-change update reassigns one action's contribution without retraining. Mean success on ten Meta-World tasks is 0.754, against 0.710 without the pathway and 0.524 for TD-MPC2. Edits chosen to improve control remain exploratory; the held-out Pick-Place gain fails Holm correction.
Critical strengths
At a fixed physical context the exposed operator is a fixed linear map, so an action perturbation moves the pre-normalization prediction by exactly that map applied to it. Prediction, inspection, and intervention all attach to this component, and post-hoc attribution offers no such target for revision.
The minimum-change edit intervenes on the mechanism while holding its input fixed: one action receives a prescribed object contribution, and orthogonal action directions are preserved. The closed-form guarantees are proved and audited, closed-loop removal of the pathway reduces success, and the six column-scaling candidates that fail Holm correction are reported alongside the rest.
Critical weaknesses
The audited minimum-change edit is never applied during control. Closed loop uses removal, gate saturation, β rescaling, and column scaling, with no rule for choosing the anchor action and target contribution at each step. No edit improves behavior after correction for multiple comparisons: the held-out Pick-Place gain fails Holm correction.
The alignment baselines come from the Factorized model, so model and access method change together; the full model's same-model comparison is unreported. Under this confound the pathway leads nine of nine tasks against seven of nine per baseline (AUPRC 0.342 vs 0.313), a margin the paper calls modest.
Questions for authors
The audited minimum-change edit is never used in control. Could you report closed-loop results with it, and state how the anchor action and target contribution are chosen at each step?
The alignment baselines come from the Factorized model. Could you report the same sensitivities from the full model's completed transition?
Table 1 gives 0.754 ± 0.043 against 0.710 ± 0.040 without defining the ± or providing per-task results or a test. Could you clarify both?
2 comments
Thank you for the clarification and the additional experiments. The closed-loop test answers my main question, but the effects are task-dependent, so I keep my rating at 3.
Response to Reviewer Comments
We thank the reviewer for recognizing the value of an explicit, editable action-to-object pathway. We conducted additional experiments to address the two weaknesses and three questions.
Weakness 1 & Question 1: Minimum-Norm Editing in Control
Response to Weakness 1 and Question 1
We have implemented the original minimum-norm edit in closed-loop MPC. At each decision step, the unedited planner first produces an anchor action a0. A predefined coordinate-removal or sign-flip rule sets the target contribution c∗; the rank-one update is then applied to root transitions during a second planning pass, without changing model parameters or forcing the anchor action to be executed.
We completed 720 paired rollouts on Door-Open, Drawer-Close, and Push (3 seeds × 20 initializations × 4 conditions per task). Sham trajectories matched the originals exactly. Edits changed MPC decisions and simulator trajectories: for example, Push terminal success changed from 71.7% to 85.0% under removal, while Door-Open changed from 50.0% to 33.3%. This directly verifies that the minimum-norm edit has consequences beyond the fixed-state algebraic audit.
We also evaluated evidence-guided targets rather than targets specified solely from model predictions. An external diagnostic mapping was fitted from independent simulator interventions; regularization and edit strength were chosen using validation prediction error, without task-success sweeps or test-set selection. The original CSB checkpoints remained frozen.
On held-out target-geometry configurations, all 10 frozen checkpoints (5 per task) showed lower absolute next-step primary latent MSE against independently collected simulator transitions. This tests prediction correction, not only exact realization of a prescribed internal contribution.
Weakness 2 & Question 2: Same-Model Attribution Comparison
Response to Weakness 2 and Question 2
We repeated the attribution audit on the same 45 frozen CSB checkpoints (9 tasks × 5 seeds). All scores were computed on identical model states and actions and evaluated against the same independent simulator-intervention labels, removing the previous cross-model confound.
The intrinsic score remains competitive in this controlled comparison (raw minus Jacobian: +0.0051, hierarchical 95% CI [-0.0082, 0.0170]). Unlike post-hoc sensitivities, the pathway is itself part of the forward transition and can be edited directly.
Question 3: Table 1 Statistics
Response to Question 3
The reported 0.754±0.043 and 0.710±0.040 are mean ± SEM across five training-seed MT10 averages. We checked the original 100 task-seed evaluation records and reconstructed the per-task mean terminal success:
CSB achieves higher mean success on five tasks and ties on two. The mean paired difference is +0.044 (95% CI [-0.039, 0.127], p=0.260). These results confirm that adding the explicit editing interface maintains competitive control performance. We will clarify the SEM definition and include the task-level results in the revision.