- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper examines a failure case for foundation inference models that aim to infer one dynamical law, along with its uncertainty, from a collection of trajectories. The usual interface presumes every trajectory comes from the same underlying system, yet the input tensor provides no information about trajectory provenance or which source each trajectory belongs to.The authors refer to this failure mode as context aliasing: when trajectories from different systems are combined, the model produces a confident estimate of a pooled pseudo-law, and its built-in uncertainty does not indicate that the single-law assumption has been breached.
The paper is technically rigorous, well written, and notably open in distinguishing between uncertainty conditional on a one-law experiment and evidence that the experiment itself is sound. My primary concerns relate to how novel this is compared with standard work on model misspecification and posterior predictive checks, the limited coverage of backbones, the somewhat advantageous setup of the controlled stationary construction, and the disconnect between a strong oracle-style witness and the much weaker detector that could actually be deployed.
Critical strengths
-
The paper addresses an important and often overlooked failure mode in scientific foundation models, and it provides suitable reproducibility details along with a discussion of limitations.
-
The Markovization approach is technically straightforward and cleanly separates the impact of missing trajectory provenance, while the comparison between the oracle path-level detector and the model’s native uncertainty offers strong evidence of a representation gap.
-
The paper tests meaningful control strategies and shows their practical implications for generator estimation and first-passage-time prediction.
Critical weaknesses
-
The core idea is not clearly distinct from traditional notions of model misspecification. As a result, the contribution’s novelty mainly lies in extending this perspective to foundation-model interfaces.
-
Just two base inference models are assessed. They both originate from a closely connected research line and use the same set-to-one-law interface.
-
The paper contrasts the model’s native uncertainty with source error, even though that uncertainty was not intended to reflect that quantity. The authors might consider highlighting the semantic mismatch in what the uncertainty represents, rather than treating it as standard miscalibration.
Questions for authors
How do the results change with fewer trajectories or shorter trajectories?
How would the proposed test handle observation noise or partially observed states?