- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the failure of Euclidean latent distance as a terminal cost for planning with pretrained world models and proposes a Trajectory Reachability Model (TRM) to improve action selection. TRM learns a pairwise temporal-distance predictor from logged trajectories and uses it to rank predicted terminal states without modifying the frozen encoder, dynamics model, or controller. The authors further introduce a selection audit with shared candidates (SASC) and subspace interventions to analyze why task-relevant information can be preserved in latent representations but underweighted during planning. Experiments on TwoRoom demonstrate substantial improvements in navigation success, with additional evaluations on PLDM, TopoNav, and PushT examining transferability and limitations. The results suggest that appropriately learned terminal costs can significantly improve latent-space planning, although their effectiveness depends on trajectory coverage, model characteristics, and task dynamics.
Critical strengths
-
The paper provides useful evidence that the poor performance of Euclidean latent distance is caused by the underweighting of task-relevant latent directions rather than the absence of necessary information in the learned representation. In particular, Table 11 shows that the XY-related subspace accounts for less than 1% of the total latent squared distance, yet planning with this subspace alone achieves substantially higher success rates than the original latent distance. Together with the shared-candidate ranking audits, these results provide a convincing explanation of the terminal-cost failure and represent an informative contribution to understanding planning with latent world models.
-
The paper demonstrates substantial improvements in the main TwoRoom evaluation while keeping the world model and controller fixed. In particular, Table 22 shows that TRM improves success from 7.0% to 96.7% even after excluding all evaluation-source episodes from training, whereas the matched shuffled-label control achieves 0.0% success. These results, together with the candidate-ranking analysis and temporal-horizon ablations, provide compelling evidence that the improvements are related to meaningful temporal supervision rather than merely introducing an additional learned prediction head.
Critical weaknesses
-
Although the main TwoRoom results are impressive, the effectiveness of TRM varies substantially across checkpoints and evaluation settings. In particular, Table 40 shows that, among seven additional checkpoints, four improve and two remain unchanged, with the confidence intervals for these six comparisons including zero, while one checkpoint experiences a significant performance degradation from 90% to 60%. The underlying cause of this failure is not sufficiently explained. Furthermore, the evidence for applying the default temporal TRM beyond TwoRoom remains limited: TopoNav uses hand-designed features, exact dynamics, and shortest-route injection, while PushT relies on task-state distance supervision rather than the proposed temporal labels. Although these experiments are informative diagnostics, they do not fully establish the robustness or general applicability of the proposed temporal reachability approach to more challenging learned world models.
-
The central idea of learning a goal-conditioned distance or reachability function for visual planning is closely related to existing work, including Model-Based Visual Planning with Self-Supervised Functional Distances (Tian et al., 2021) and Learning Temporal Distances through Contrastive Successor Features (Myers et al., 2024). While these approaches are discussed in the related work, the paper does not provide direct experimental comparisons that isolate the benefits of TRM's architecture, temporal supervision, and pair-sampling strategy. The current comparisons primarily involve raw latent distance, simpler metric transformations, and alternative supervision applied to the proposed pairwise head. A properly adapted baseline using the same frozen world model, offline trajectory data, and planning budget would be important for establishing the incremental technical contribution and novelty of TRM relative to existing learned-distance methods.
Questions for authors
-
What causes the substantial performance degradation for one checkpoint in Table 40? The epoch-3 checkpoint experiences a decrease in success from 90% to 60% after applying TRM, while other checkpoints show improvements or unchanged performance. Could the authors investigate whether this degradation results from differences in latent representation quality, world model rollout accuracy, temporal-distance prediction errors, or candidate ranking? A more detailed explanation would help determine under which conditions TRM can be applied reliably and would materially affect my assessment of its robustness.
-
Can the authors evaluate the default temporal TRM on PushT using the same experimental protocol? The current PushT experiments use task-state distance supervision, which differs from the temporal supervision proposed as the main contribution. Could the authors extend the existing offset-50 experiment by comparing raw latent distance, temporal-TRM hybrid, and shuffled-temporal hybrid under the same frozen world model, controller settings, and hybrid weight? Ideally, evaluation-source episodes should be excluded from temporal pair training, and success rates and final task distances should be reported across the existing evaluation seeds. This comparison would provide more direct evidence of whether the proposed temporal supervision generalizes beyond navigation tasks.
-
How does TRM compare with existing learned functional or temporal distance methods under matched conditions? Could the authors include an appropriately adapted baseline based on the learned-distance component of Tian et al. (2021) or Myers et al. (2024), using the same frozen representation, offline training data, and CEM planning budget? Such a comparison would help clarify whether the observed improvements arise from the specific TRM formulation and full-horizon sampling strategy or from the more general benefit of replacing Euclidean distance with a learned reachability cost.