- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies context encoding for world models when training varies each subsystem’s parameters in isolation but testing varies all of them. It proposes Compositional Context Encoding (CCE), which uses one GRU encoder per subsystem, each reading only its own substate, plus an auxiliary loss that regresses inferred parameters onto ground-truth values. The approach is tested on a decoupled double-pendulum benchmark.
Critical strengths
The question of how context encoders generalize to unseen parameter combinations is relevant to model-based RL.
Critical weaknesses
-
All experiments use a single toy environment where the proposed factorization holds by construction. That is clearly substandard for ICLR.
-
The results consist of one environment and one table, shown again as one bar plot, over three seeds. All comparisons are internal variants, oracle references, or a deliberately weakened lower bound. No existing baseline (e.g., PEARL, CaDM) is evaluated.
-
The central claim that a global encoder fails rests on a single-seed appendix experiment, and it is unclear whether that model used the auxiliary loss the paper shows is decisive. That auxiliary loss requires ground-truth physical parameters for every training trajectory, and the method fails without it. Such labels are only available in simulation and make the paper not really applicable in practice.
Questions for authors
Q1: Can you add meaningful baselines and more experiments?
Q2: How does the approach work without ground truth?