- Rating
- 3
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
Authors proposed a query-conditioned framework when the available data is incomplete. The paper argues that real world materials data doesn’t sit in a typical value but within a range and under specific temperature or other variables. The method supports various characteristics appear in material science data, while preserve its associated condition under such heterogeneous representation. The method leverage masking to learn the missing material properties and able to provide constraint to support the downstream engineering application.
Critical strengths
- S1: The author designed the learning problem by considering the nature of the material science domain problem, which often have a variable collection of observations. The proposed query-conditioned framework works well on the heterogeneous material science data.
Critical weaknesses
- W1: The authors acknowledged the full objective in Equation (3) is an extension, which is not being tested for evaluation. However, it’s unclear whether the proposed joint optimization is beneficial for downstream tasks.
Questions for authors
- The experiment suggests that pretraining doesn’t help much. Do authors have intuition on how to train a better representation that transfer to downstream tasks?
Response to Reviewer ciL4
Thank you for recognizing the importance of retaining conditions and ranges when learning from materials evidence. Combining that evidence improves completion: on material-group splits, the joint predictor reduces MAE from 104.39 MPa for context-only boosting to 69.58 MPa, while chemistry/process-only boosting obtains 132.64 MPa. The learned hidden curves also support evaluated operating windows. These gains come from the implemented specialists; the benefit of learning one shared representation remains unresolved.
The joint-training experiment adds joint-requirement supervision to a matched neural regressor. Its cost improves from 0.33640 to 0.32512 and from 0.33642 to 0.32364 in two seeds, and worsens from 0.30535 to 0.31800 in the third. Boosting remains stronger on this cost. This demonstrates feasibility and occasional gains, but no consistent downstream advantage. The complete objective in Equation (3) has not been jointly optimized across all evidence types.
For transfer, our working hypothesis is that the auxiliary task needs to match the downstream question more closely. The current test uses a small MLP, two pretraining passes, and adaptation with only 64 labeled target-bearing groups per fold. Its pretrained, scratch, and shuffled-label variants are essentially tied, so we cannot infer that the representation has learned transferable material structure. A more informative next test would train on whole withheld response curves and condition-dependent property views, retain the observation roles and conditions in the representation, and balance the auxiliary tasks so that common scalar properties do not dominate. Conditioned-set models such as Conditional Neural Processes offer a relevant architecture and comparison for that experiment.
A test of these training hypotheses should retain the scratch and shuffled-label controls, include strong tabular baselines, and hold out downstream property families or sources as well as material groups. That design would separate better supervised fitting from a benefit due to transferable representations.