- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies grid-cell prediction in physical systems with heterogeneous sub-grid structure, where the observed cell-level target is an aggregate of several latent constituent responses. The authors argue that conventional monolithic neural models may entangle the effects of different sub-grid components, leading to poor generalization when constituent fractions change.
To address this issue, the paper proposes UniTeD (Unified Tiled-Expert Demixer), which combines a shared trunk encoder, a FiLM-conditioned shared expert for modeling tile-specific latent responses, and a physics-prescribed aggregation layer that combines these responses using known tile fractions. By restricting the fractions to the final aggregation step, UniTeD explicitly enforces linear superposition and prevents the latent tile responses from directly depending on the mixture configuration. The paper further provides a theoretical identifiability analysis under regularity, structural-exclusion, and local non-degeneracy assumptions.
The method is evaluated using both controlled synthetic benchmarks and ERA5 surface-energy-flux prediction. Synthetic experiments examine latent-process recovery, zero-shot compositional generalization, few-shot transfer, nonlinear interactions, and noisy tile fractions. On ERA5, UniTeD achieves substantially better robustness under mixture-to-pure and pure-to-mixture distribution shifts and reports up to approximately 28% error reduction relative to the strongest baseline, together with improved geographical generalization.
Critical strengths
The paper's strongest aspect is the close alignment between the model architecture and the assumed physical structure. UniTeD does not ask a generic network to infer how constituent fractions should interact; instead, the model learns tile responses independently of the fractions and combines them through the prescribed physical aggregation rule. The use of a shared FiLM-conditioned expert also provides a natural mechanism for transferring information between related, data-rich and data-scarce tiles.
The experimental design is another important strength. The synthetic experiments directly test latent disentanglement, unseen mixture generalization, and few-shot transfer, while the ERA5 experiments demonstrate meaningful gains at much larger scale. The additional experiments involving fraction noise, nonlinear coupling, and geographical distribution shift substantially improve the completeness of the empirical study.
Critical weaknesses
The first concern is that the paper somewhat overstates the connection between the theoretical identifiability result and the ERA5 experiments. The theoretical argument relies on locally full-rank, sufficiently well-conditioned fraction matrices under nearly fixed forcing, whereas the empirical condition-number distribution contains a substantial ill-conditioned tail. Moreover, aggregate predictive stability in these regions does not by itself imply that all latent constituent functions are uniquely and accurately recovered.
A second concern is that the real-data experiments cannot directly verify the central latent-disentanglement interpretation because ERA5 does not provide ground-truth tile-level fluxes. Improved performance under composition shifts is certainly consistent with successful physical disentanglement, but it is not uniquely diagnostic of it. Relatedly, the nonlinear-coupling robustness experiment evaluates recovery of pure, uncoupled tile responses after training on coupled mixtures; this is useful as a stress test, but it does not demonstrate that the current linear aggregation architecture can accurately predict genuinely coupled mixture outputs at deployment time.
Questions for authors
Could the authors clarify more quantitatively how the ERA5 condition-number analysis supports the local non-degeneracy assumption in Theorem 3.1? Given the very large condition numbers in the upper tail, it would be helpful to report the distribution of , or the fraction of neighborhoods satisfying a concrete lower-bound criterion required for numerically stable latent recovery.
Could the authors also clarify the intended strength of the latent-function recovery claim on ERA5? Since only aggregate flux targets are available, the current experiments directly validate aggregate prediction and compositional generalization rather than the correctness of each latent tile response. An external tile-level diagnostic, comparison against outputs from a process-based land-surface model, or a counterfactual consistency test would help distinguish true physical disentanglement from a useful but potentially non-identifiable internal representation.
4 comments
2. Could the authors also clarify the intended strength of the latent-function recovery claim on ERA5? Since only aggregate flux targets are available, the current experiments directly validate aggregate prediction and compositional generalization rather than the correctness of each latent tile response. An external tile-level diagnostic, comparison against outputs from a process-based land-surface model, or a counterfactual consistency test would help distinguish true physical disentanglement from a useful but potentially non-identifiable internal representation.
We agree with the reviewer’s assessment. Since the public ERA5 archive only provides grid-level aggregate fluxes, we cannot directly verify the strict correctness of each individual latent tile response. In the revised manuscript, we will explicitly clarify the intended strength of our claims on ERA5: the latent tile functions learned on ERA5 should be interpreted as physically guided approximations rather than strictly verified ground-truth responses.
Regarding the suggestion of an external tile-level diagnostic, we note that regenerating these global datasets using a coupled, process-based land-surface model (like HTESSEL, the underlying land-surface model for ERA5) to extract internal tile-level states requires significant High-Performance Computing (HPC) infrastructure and massive data storage typically only accessible to major operational climate/research centers. For the broader research community, relying on ERA5 provides a standardized, globally recognized, and operationally validated dataset, which ensures our evaluation is reproducible and comparable to state-of-the-art benchmarks. This structural barrier to accessing real-world tile-level ground truth was the exact motivation for our two-tier experimental design.
Our controlled synthetic benchmark serves as a "counterfactual consistency test" for latent-process recovery. By mimicking the aggregation processes of a land-surface model in a controlled environment, we empirically show that UniTeD can recover good approximations of the tile functions when trained only on mixtures (Figures 2 & 3) and generalizes to novel compositions (Figures 4 & 5). Following this proof of concept, our ERA5 experiments were designed to test whether a machine learning model, structurally constrained to be faithful to the underlying physics of these simulators, could scale to challenging data at global scale.
Even interpreted as internal representations or approximations of tile functions, this capability is vital for practical applications. Under anthropogenic and natural shifts, such as global urbanization (which is transforming global landscapes), models must frequently generalize to entirely unseen landscapes (Chaney et al., 2018; Torres-Rojas et al., 2022; Yin et al., 2023). A highly relevant example of this is counterfactual urban planning: when decision-makers assess how building a new park, an artificial lake, or a massive building complex might impact a city's microclimate, the modeling tool must predict the physical response of a completely novel tile composition. An architecture like UniTeD, which can operate with unknown tile compositions, is more useful for these downstream scientific and planning applications.
Thanks for addressing my concerns. I will maintain my score.
We appreciate the reviewer’s response. Are there any remaining concerns critical to your assessment that we could address?
We thank the reviewer for their constructive feedback. We have addressed the reviewer’s questions regarding the quantitative numerical stability of our theoretical assumptions and the intended scope of our latent recovery claims on the ERA5 dataset in our point-by-point responses below.
The minimum singular values of the local fraction matrices have the following distribution:
We found these results consistent with the long-tailed condition-number distribution reported in Appendix D.6. As discussed there, we observed that extreme condition numbers tend to occur in vast, homogeneous regions, where some tile types are absent or have negligible coverage and the corresponding fraction-matrix columns are zero or nearly zero.
In the limiting case of a neighborhood composed entirely of one tile a, the aggregation equation simplifies to:
yi=1⋅Φa(xi)+∑k=a0⋅Φk(xi)=Φa(xi)
Thus, although the full fraction matrix is rank-deficient, the active tile response is directly supervised by the aggregate target, without requiring unmixing. The absent tile responses remain locally unconstrained, but they do not contribute to these cells’ aggregate outputs. Therefore, a large condition number in such a region does not by itself imply difficulty in aggregate prediction.
For neighborhoods whose fraction matrices have full column rank, Equation 11 in Appendix A.3 provides the latent-recovery error bound through the pseudoinverse, with sensitivity governed by 1/σmin(AB). Larger minimum singular values yield tighter bounds when the other terms are held fixed. For rank-deficient neighborhoods, the pseudoinverse constrains only observable combinations of tile responses, rather than identifying every tile response.
Homogeneous neighborhoods can directly supervise their active tile responses, whereas recovering all latent responses requires the local non-degeneracy assumption. These diagnostics do not establish uniformly stable recovery of all latent tile responses on ERA5; rather, they characterize the strength and limitations of the local constraints. We will clarify this distinction in the revised manuscript.