- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper first points out that learned world models often struggle to generalize to unseen physical properties, such as object mass, because they implicitly learn the dependence between physical parameters and interaction dynamics. To address this, the paper proposes active hidden-physics canonicalization, which predicts a factor-independent motion effect, estimates the hidden physical parameter through a controlled visual probe, and applies the estimated parameter using a fixed analytical operator. The method aims to improve out-of-distribution generalization by explicitly separating known physical relationships from learned dynamics.
Critical strengths
-
The paper investigates a meaningful problem in out-of-distribution generalization by examining how known physical relationships should be incorporated into learned world models.
-
The experiments are well controlled, with consistent improvements across five backbone architectures. The additional ablation studies also help clarify the sources and limitations of the observed improvements.
Critical weaknesses
-
The paper lacks sufficient baselines to isolate the source of the performance improvement. The learned-conditioning baseline only uses additive feature embeddings, while alternative conditioning mechanisms are not explored. More importantly, the paper does not compare against a standard world model with simple post-hoc scaling, making it unclear whether learning a mass-independent effect is necessary or whether the improvement mainly comes from correcting the predicted motion scale.
-
The evaluation only considers a single direction of physical distribution shift, with models trained on lighter objects and tested on heavier ones. Since heavier objects generally produce smaller displacements under the assumed physical law, the observed improvement may primarily reflect motion scale reduction. Evaluation on lighter unseen masses, heterogeneous mass distributions, and longer prediction horizons would provide stronger evidence of generalization.
-
The proposed approach mainly combines established techniques for physical parameter estimation and explicit physics-based modeling. The inverse-mass estimator uses simple linear regression, while the canonicalization mechanism applies a predefined physical relationship through fixed multiplication. Although the empirical improvements are substantial, the methodological contribution beyond existing physics-informed modeling approaches remains limited.
-
Several important implementation details are insufficiently specified, including the simulator dynamics, action representation, training objective, and aggregation of normalized prediction errors. In particular, the assumptions underlying the inverse-mass factorization need further clarification. These details are necessary to interpret and reproduce the reported results.
-
The overall research depth and experimental validation appear insufficient for a full conference paper. Several important aspects remain underexplored, including stronger baselines, the underlying reasons for the failure of learned conditioning, and generalization beyond the specific experimental setting. These limitations weaken the completeness and significance of the work.
Questions for authors
-
Could the authors provide stronger baselines, such as alternative learned-conditioning methods and a standard world model with post-hoc scaling, to better isolate the contribution of the proposed canonicalization? Additionally, why does the current learned-conditioning baseline perform similarly with estimated and oracle mass?
-
Could the authors evaluate the method on unseen lighter masses, heterogeneous mass distributions, and longer prediction horizons? Given the findings in Tables 4 and 5, it would also be useful to examine when accurate per-object identification is necessary and how probe length affects downstream prediction performance.
-
Could the authors clarify the simulator dynamics, action representation, and training objective for the canonical raw effect? In particular, under what assumptions does the inverse-mass factorization hold, and how is the normalized prediction error computed?