- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper claims to present a "physics aware constitutive learning framework" for predicting material behaviors at elevated temperature. The application is gathered from a dataset published in 2025 (Agha et al. 2025), which also provides the machine learning framework.
As the basic learning technique already was proposed in past work---and is fairly rudimentary by machine learning research standard---the contribution here is essentially the "physics informed" loss terms and some heuristics for measuring reliability.
Critical strengths
The paper's target application is a worthy one. The idea of tailoring a learning methodology specifically to material property prediction is an interesting one broadly speaking, and I could imagine expanding on the overall thrust of this work to incorporate more advanced or specialized architectural designs/losses.
Critical weaknesses
This paper is very clearly below the standard of ICLR and does not bring substantial progress to research in machine learning. The application already appeared in past work as did the dataset and the training procedure, so what's left are mostly the new loss terms and the reliability measures.
The new loss terms are hardly "physics informed" (at least in the typical sense from the "physics informed neural network" literature), in that there are no penalties for deviating from physical principles/laws; they don't seem any more physics informed than the original loss (also built from the dataset) unless I am missing something fundamental. Rather these loss terms are closer to consistency measures within the dataset, e.g. penalizing differences in neighboring ROIs in time sequences from the dataset. The losses are reasonable but simplistic, and they are not carefully ablated (e.g., the lambda values in eq4).
The reliability framework is heuristic and mostly composed of simplistic heuristics built on standard statistical computations.
There are "hard coded" constants in the paper that should be tested and discussed, e.g. coefficients of loss terms and assorted constants in (9).
There are also substantial writing/clarity issues:
- Much of the notation in the paper is not carefully defined, and perhaps requires knowledge of past work. For example, I think the sigmas in losses (1)-(4) are stress values.
- The MAPS acronym is never spelled out
Questions for authors
Are the improvements noted in the first paragraph of sec 4.1 significant enough to make a difference in applications?
The conclusion claims that the paper answers which materials to add to the training dataset next. Is this claim tested empirically, e.g. by implementing an 'active learning' procedure wherein new data is introduced and the model is refined?
2 comments
Response to Reviewer KySP (2/2): Practical Significance and Experimental Validation
Response to Reviewer KySP (2/2)
6. Questions for Authors
Q1. Are the improvements reported in Section 4.1 significant enough to matter in applications?
We appreciate this question, as the distinction between pointwise prediction accuracy and constitutive fidelity is central to our motivation.
Relative to the MSE-only baseline, the complete model reduces Shape RMSE from 1.36 to 0.97 (28.7%), Monotonicity Violation from 0.20 to 0.12 (40%), and seed-to-seed MAPE variability from 1.18% to 0.84%, while mean MAPE changes only modestly from 6.43% to 6.80%.
We therefore view the primary benefit as improved constitutive-response fidelity rather than improved pointwise prediction accuracy. Because constitutive models are used as complete stress-strain trajectories, agreement in individual stress values does not necessarily imply faithful reproduction of the underlying constitutive response. As shown in Section 4.1 and Figure 3, the physics-aware model more closely follows the reference trajectories and reduces non-monotonic artifacts.
We do not claim demonstrated improvements in downstream engineering simulations or structural design outcomes. Application-level validation remains important future work.
Q2. Is the claim about identifying materials for dataset expansion tested empirically through an active-learning procedure?
We agree that empirical validation of the material-selection capability is important.
To address this concern, we expanded Section 4.2 and Table 1. Four materials identified as CAUTION (AA7075-T6, AA2024, AA5052, and AA3003-H14) were incorporated into the training dataset and the model was retrained. Their mean MAPE reductions ranged from 37.5% to 57.3%, with an average reduction of 50.3%.
We emphasize that this is not a complete active-learning benchmark and does not establish superiority relative to alternative acquisition strategies. Rather, it demonstrates the effect of incorporating materials identified as having limited support within the existing training distribution.
We also added a controlled characterization study in Section 4.3 and Figure 4. For AA3003-H14, framework-guided characterization increased coverage in the targeted 300--350°C region from 2 to 4 observations and reduced disagreement from approximately 13% to 9%, whereas a control test outside the target region produced little change.
Together, these studies provide preliminary evidence supporting the practical utility of the framework for both dataset expansion and experimental planning. A full sequential active-learning benchmark remains an important future extension.
Closing Remarks
We thank the reviewer again for the constructive feedback. The revised manuscript strengthens the proposed framework through component-level ablations, threshold-sensitivity analyses, controlled characterization studies, and expanded methodological explanations.
Together, these additions provide stronger empirical support for the physics-aware learning objectives, the materials-space reliability assessment, and the coverage-disagreement framework, while clarifying their intended scope and limitations. We hope the revised results and analyses address the reviewer’s principal concerns and more clearly demonstrate the practical value of the proposed approach.
Response to Reviewer KySP (1/2): Novelty, Physics-Aware Learning, and Reliability Assessment
Response to Reviewer KySP (1/2)
We sincerely thank the reviewer for the thoughtful evaluation and constructive feedback. In response to the concerns regarding novelty, physics-aware learning objectives, reliability assessment, parameter selection, and presentation clarity, we substantially revised the manuscript and added new ablation, sensitivity, and validation studies.
1. Novelty and Contribution Beyond the Previous MAPS Benchmark
We agree that the MAPS dataset and baseline MLP architecture were introduced in Agha et al. (2025). Our contribution is not a new dataset or neural-network architecture, and we have clarified this distinction in Sections 2, 3.1, and 3.2.
Rather than introducing a new benchmark, this work extends the MAPS framework in three complementary directions:
(i) Physics-aware constitutive learning to improve curve fidelity;
(ii) Materials-space reliability assessment to identify limited-support materials and extrapolation risk;
(iii) Coverage-disagreement-driven experimental planning to identify thermo-mechanical regions requiring additional characterization.
Our contribution lies in integrating these capabilities into a reliability-aware constitutive-characterization workflow. Figure 1 and the Introduction have been revised to clarify this distinction from the original MAPS benchmark.
2. Physical Interpretation and Justification of the Learning Objectives
We agree that the proposed objectives differ from the physics-informed losses commonly used in PINNs.
Our approach is physics-aware rather than a conventional PINN formulation. We do not enforce governing equations or physical constraints as hard penalties. Instead, the proposed objectives incorporate structure associated with constitutive response trajectories.
The shape-aware loss (Eq. 2) compares predicted and reference stress increments between consecutive deformation steps, encouraging agreement in local stress evolution rather than only absolute stress values. The per-temperature mean stress loss (Eq. 3) reduces temperature-dependent prediction bias by constraining the average stress response within temperature groups.
To evaluate the contribution of each component, we added a progressive ablation study (Appendix D, Tables 5--6). Curve-wise batching alone increases MAPE from 6.43% to 9.28%, demonstrating that improvements cannot be attributed solely to batching. Adding the shape-aware objective reduces MAPE to 6.91%, while the complete framework achieves 6.80%.
The complete model also reduces Shape RMSE from 1.36 to 0.97 and Monotonicity Violation from 0.20 to 0.12. An additional monotonicity penalty increased prediction error and did not improve the overall trade-off.
These results provide quantitative evidence for the contribution of the learning objectives.
3. Reliability Framework and Its Practical Significance
We agree that the reliability framework is built from established statistical concepts. The contribution is the combination of complementary indicators into an interpretable assessment of material-space support and extrapolation risk.
To evaluate whether the indicators provide complementary information, we added a reliability-framework ablation study (Appendix B.5, Table 3). Among the three selected high-risk LOMO cases, distance alone, distance plus directional similarity, and the complete framework identify 1/3, 2/3, and 3/3 challenging materials, respectively.
We also expanded Section 4.2 and Table 1. Incorporating four CAUTION materials into the training dataset reduced mean MAPE by an average of 50.3% after retraining. While these are not independent generalization evaluations, they demonstrate that the framework successfully identifies materials that benefit most from additional characterization and inclusion in the training set.
4. Selection and Sensitivity of Hyperparameters and Reliability Thresholds
We expanded Appendix A.5 to document hyperparameter selection. The loss weights were selected through a two-stage search using 12-material LOMO cross-validation with 10 random seeds per fold (120 training runs per configuration). External-validation alloys were excluded from tuning.
We also added a threshold-sensitivity study (Appendix B.6, Table 4). AA5052 and AA3003-H14 remain classified as CAUTION across all configurations, while five materials remain consistently RELIABLE. Materials near classification boundaries show the expected sensitivity, and we clarify that the thresholds are calibrated to the current dataset rather than representing universal physical constants.
5. Improvements in Notation and Presentation
We revised Section 3.1 to define MAPS (Model-Assisted Property Specimen) and clarify its relationship to constitutive-response prediction. Sections 3.3 and Appendix A.4 were expanded to define the stress variables, Shape RMSE, and Monotonicity Violation used throughout the manuscript.