- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2(−1)
Read review
Paper summary
The paper introduces Aegis, a framework to achieve both physically differentiable modeling and neural-physical hybrid modelling of planetary atmosphere, detail its application on Mars atmosphere, and explain its performance compared to reference datasets.
Critical strengths
The proposed method (hybrid modeling with differentiable programming and neural network) is aligned with the main current direction of the ML community for atmospheric and climate science. The work is hence promising. Can be used for both physical parametrisation and coupled with a learned neural model.
Critical weaknesses
The paper does not allow reproducible results as part of the paper are hard to read, details are missing and some claims are not fully supported by the evidence. In addition, it does not indicate in which practical context the use of the model output is beneficial.
Questions for authors
A. In table 2, it is not clear if the calibration gain is significant or in the uncertainty estimates (is there any?). Also, the neural heating gain is null and is not discussed. Does it make sense to keep it?
B. In table 3, is pressure comparison relevant if very mostly correlated to terrain? Could CO₂ pressure cycle be compared with observations?
C. In table 4, why does trajectory training lose here, and is there a setting where it wins?
D. Can parameters tuned during the 5 sols gradient study be valid for the 10 years stable simulation? The gap between the two horizons seems significant
E. The paper implies Aegis generalises the modeling of planet atmosphere and then apply Mars planetary constants, but this is untested. Would have been nice to confirm the approach by exposing the results of applications on other documented planet, such as the Earth. Otherwise better to just mention it in future work if intented?
F. The writing is very heterogeneous, some paragraphs are really high level, while some others are diving directly into very technical details without introduction (especially the math related explanations), forcing the reader to trust the authors about the correctness of the implementation, because lost with numerous technical details (while not even exhaustive, c.f. hardware below). It is surprising to jump from understandable claims, to complex maths, then to very generic inline codes. For example, section 2.1 jumps from a high-level description to Eqs. 1–2 without defining dI/dt or the projection step. Another is mention of MY32 and ARCO-MACDA without introduction. This is one of the main concern of the reviewer, the gap between the clear description of the objective and the technical explainations. Could this be improve?
G. Hardware setup not detailed enough ("single GPU" or "one GPU" mentioned several times) for teams that would want to reproduce the results. What card/how much VRAM? Moreover, this is critically related to the performance claims of the approach (the execution time in comparison with reference model in Fortran).
H. Could you indicate how the output resolution, levels and frequencies of the model are useful for downstream usecase such as the operations mentioned in abstract
I. Could you harmonised the way you reference figures and tables (fullname or abbreviations) and make sure all of them are referenced? For example, Figure 1 not referenced anywhere, but useful to understand the overall architecture.
J. Section 3.2 gives the full-year CO₂ drift as 2.8×10⁻⁹. Section 3.4 gives 4.28×10⁻⁹ for "the full-physics year". Aren't these the same run?
Thank you. The framework supports updated condensation and cloud physics.
W1. Reproducibility and practical value
We provide inputs, training and averaging rules, and confirmed hardware.
We have expanded methods in Section 2.1 and Appendices B, C, and D, and explained uses in Appendix C.2.
A.1. Calibration gain and uncertainty
Calibration lowers test temperature error, a 7.84% reduction. The estimated gain interval is 0.109 to 0.314 K. It is based on only two held-out years.
We have reported this in Section 3.1 and Appendix B.2.
A.2. Null neural-heating gain
We present the neural components as a way for researchers to implement neural experiments using the AEGIS framework. We have further qualified our writing to support this view and reported the experiment values without any claims of efficiency or accuracy.
We have addressed this in Section 3.5 and Appendix B.3.
B.1. Terrain-driven pressure correlation
Shared terrain explains much of the raw agreement. Removing the elevation component reduces the given correlations compared with raw values.
We have added the adjusted correlations and method in Section 3.3 and Appendix C.1.
B.2. Observed pressure cycle
We now compare with Viking station records. Seasonal anomaly correlations are 0.959 and 0.950, while pressure errors are 56.8 and 76.0 Pa.
We have added this comparison in Section 3.3 and Appendix C.2.
C.1. Why trajectory training loses
We present the neural components and the experiments as a way for researchers to implement neural experiments using the AEGIS framework. We have further qualified our writing to support this view and reported the experiment values without any claims of efficiency or accuracy.
We have stated the budgets and results in Section 3.5.1 and Appendix B.4.
C.2. A setting where it wins
Trajectory fitting has a lower mean error on the follow-up interpolation test. Continued local fitting performs better under higher dust. The ranking depends on test conditions, and longer coupled runs also fail rollout checks. We have added the repeated tests and failures in Appendix B.4.
D. Short gradient study versus long simulation
The short study checks gradients at the default opacity; it does not tune parameters. Calibration uses shorter windows. The long integration tests whether the simulation remains finite.
We have clarified these experiments in Section 3.1 and Appendix B.5.
E. Other planets
Validation is limited to Mars. Other planets require their own physical models and tests.
We have stated the Mars scope and placed other-planet validation and terraforming in future work in Section 4.
F.1. Equations and projection
Inventory means total carbon dioxide across the tracked reservoirs. The projection corrects numerical errors in this total after each step. We have defined the budget in Section 2.1 and explained the correction and its effects in Appendices A.3 and D.2.
F.2. Dataset names and writing
The revision introduces Mars-year labels and ARCO-MACDA with their sources and averaging.
We have expanded the physical explanation in Section 2.1 and dataset descriptions in Section 3.1 and Appendices B.1 and C.1.
G.1. Hardware
Historical timing and sensitivity runs use an NVIDIA A100. New calibration and projection runs use an NVIDIA A100 40 GB VRAM and double precision. We have added confirmed hardware and timing scope in Appendix D.3.
G.2. Speed comparison
Hardware and configuration differences prevent a fair Ames speedup claim. We have removed it and report absolute throughput in Section 3.2 and Appendix D.3.
H. Resolution and practical use
The model uses a 64 by 32 transform grid with 12 vertical layers; comparison fields are saved about hourly. This supports coarse global and seasonal studies. Operational forecasts need local validation. We have specified resolution in Section 2.1, sampling in Appendix C.1, and uses in Appendix C.2 and Section 5.
I. Figures and references
We have cited the architecture figure in Section 2.2, checked cross-references, and corrected duplicate material and the seasonal count in Appendix C.
J. Conflicting annual drifts
These values come from different runs. The drift of 2.8 parts per billion belongs to the cold-start timing run with a 450-second step; 4.28 parts per billion belongs to the restart-based ablation with a 300-second step. Both measure the largest relative inventory drift at saved times.
We have distinguished the runs in Sections 3.2 and 3.4 and Appendix D.2.