- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies dynamics generalization, where a learned dynamics model must adapt to a new environment at test time. Using the continuous-control environments of the CaDM benchmark, the authors demonstrate that a standard sequence model using recent state-action-next-state transitions as context can outperform vanilla, stacked, and meta-learning baselines while remaining competitive with specialized context-encoder approaches. The paper further investigates the role of context through a series of ablations that modify the transition history and analyzes how performance varies under different train-test distribution shifts.
The central finding is interesting: full transition histories appear to provide a powerful mechanism for context-based adaptation, enabling effective zero-shot generalization through a single forward pass without requiring additional adaptation procedures or test-time optimization. However, the exposition of the paper is lacking and he work would benefit from deeper analysis to support some of its broader conclusions
Critical strengths
I found the main direction of the paper interesting and worthwhile. If I were to summarize its strengths:
(+) Introduces full state-action-next-state transitions as a simple yet effective mechanism for representing context
(+) Enables genuine zero-shot adaptation through a single forward pass without requiring additional optimization procedures, gradient updates, or specialized adaptation modules at test time
(+) Achieves competitive performance compared to both meta-learning and context-encoder approaches
(+) Includes an extensive collection of benchmarks, ablations, and failure-case analysis
Critical weaknesses
While I appreciate the paper's central empirical finding, I believe the current version has a number of issues related to clarity, experimental analysis, and interpretation of results:
(-) The text needs polishing since it is hard to parse at times obscuring the potential contributions of the proposed work. For example
- Lines 25-26: "Permuting which next state follows which transition costs almost as much as removing the context outright,"
- Line 51: "...and an ensemble variant clears both variants of the purpose-built context-aware method outright on three of the six while staying inside seed noise on two more." - Final contributiom bullet point
- Line 156; "Keeping the next state inside the item": what item?
- Lines 266-268: "On HalfCheetah, where CaDM maintains...or search budget."
In addition, certain paragraphs feel too AI generated for my liking. See, for example, "Changing what the context is" in line 365 and all subsequent paragraphs in the results section
(-) The ensemble results play an integral role in the experimental evaluation, yet the paper provides very limited information. It is unclear what differs across the independently trained models and how ensemble diversity is achieved. The authors should provide more information rather than expecting reviewers to refer to refer to a 2018 paper to understand the experimental setup.
(-) One of the central claims is that the model extracts useful dynamics information from individual transitions rather than from long temporal contexts. However, I do not believe the presented evidence fully supports this conclusion. Figure 4 is a useful starting point, but similar analysis should be reported for all environments and moved into the main paper. Furthermore, in the extreme settings, performance appears to continue improving as additional context transitions are provided. This observation contradicts with the authors claim that performance saturates after only 2-4 transitions.
(-) Several analysis focus on 1-2 environments while providing limited discussion of the remaining environments. For example, the sections "Corrupting the context" and "Changing what the context is" focus primarily on HalfCheetah. Similarly, Figure 5 is difficult to interpret. It is unclear what varies in the reported "above-training-range" and "below-training-range" settings, and what is the baseline for the reported mean differences (is t no context?) In any case, statements like "This confirms that the direction of distribution shift, rather than its magnitude, governs context utility" are difficult to justify based on a small subset of environments.
(-) The authors argue that individual transitions are particularly informative. However, I believe the sequential structure of the context may itself play an important role. In particular, the proposed approach leverages a history of observed transitions to infer latent environment dynamics, thereby utilizing information that is not available under a strict first-order Markov assumption. In this sense, results such as those in Figure 2, where context shuffling or the use of transitions from different episodes substantially degrades performance in challenging environments such as Ant and Humanoid, seem to suggest that temporal consistency and sequence structure remain important factors.
(-) Finally, it's not clear how well the approach can extend to more challenging domains. The authors note that performance degrades in the out-of-training Ant setting, raising questions about scalability to more complex environments. While evaluating additional domains such as robot manipulation may be beyond the current scope, the paper would benefit from further anlysis of the failure cases and the limitations of the proposed context mechanism
Questions for authors
-
What do the numbers in table 14 report? Improvement over the single context model or the no-context one?
-
Similarly, see my comments above and clarify the results in Figure 5
-
Could you provide a full version of Figure 4 that includes all environments