- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
In this paper, the inverse design of nonlinear mechanical metamaterials is studied. The conditional diffusion model is used to generate a two-dimensional SDF structure that meets the requirements of the target stress-strain (SS) curve and volume fraction (VF), and the NOT surrogate model and ABAQUS FEM are combined for candidate screening and high fidelity verification. A DBTL (design build test learn) closed loop based on residual guidance is designed to calibrate the surrogate model.
Critical strengths
- The three conditional injection mechanisms of B1/B2/B3 are compared in detail, and the advantage of cross attention+film (B2) in decoupling multiple physical field signals is established.
- Through the systematic FEM verification of r0-r30, the generalized boundary of SDF diffusion model extrapolated by deep VF is quantitatively detected.
- The observation that the proxy prediction accuracy is inconsistent with the actual sorting performance deserves attention
Critical weaknesses
1. Conceptual Conflation: OOD Generalization Failure vs. Selection-Induced Optimism
The surge in proxy error from to might driven by the fact that the independent 1K test set features a significantly wider Volume Fraction (VF) range ([0.226, 0.613] vs. [0.262, 0.553]) and more complex topologies (as acknowledged in Appendix A.2.3, Table 3). This demonstrates the proxy model's poor Out-of-Distribution (OOD) generalization, rather than the traditional notion of "optimistic bias."
The true "optimistic bias" (or selection-induced optimism) is more accurately captured in Appendix Table 11: for the same batch of generated candidates, the proxy's predicted error () is systematically much lower than the true FEM error (). This occurs because the proxy inherently "favors" or over-ranks the specific samples it happens to predict most accurately during the Top-4 screening process (a classic manifestation of Goodhart's Law or surrogate overoptimization).
By conflating "cross-distribution generalization failure" ( vs. ) with "in-distribution selection bias" ( vs. ) under the single umbrella term of "optimistic bias," and subsequently using the former as the primary motivation to introduce the SFV loop, the authors commit a clear conceptual conflation that undermines the logical rigor of their methodological motivation.
2. Insufficient Ablation on Conditioning Capacity and Missing Full-Pool Baseline for SFV
While the empirical results are valuable, many experiments only prove the effectiveness of the complete scheme but fail to isolate why the specific mechanisms emphasized by the authors are effective.
- Parameter Mismatch in Conditioning Modules: The total parameter count of B2 is only ~12.6% larger than B3, but its conditioning module contains roughly 6.7× more parameters. Consequently, the performance drop in B3 cannot be solely attributed to the absence of cross-attention, but may partly stem from insufficient capacity in its conditioning module. A parameter-matched ablation is necessary to isolate architectural benefits from capacity stacking.
- Missing Full-Pool Baseline and the "Budget Paradox": The SFV loop utilizes a pool of 3,675 FEM-labeled samples over up to 10 rounds of residual-guided cumulative fine-tuning. However, the paper lacks a direct comparison with a S2 full-pool fine-tuning baseline.
- The Budget Paradox: Crucially, the calculation of residuals inherently requires ground-truth FEM labels. Since the paper operates on a pre-existing pool of 3,675 FEM-labeled samples, the full set of labels is effectively available from the start. Therefore, the standard active learning justification (saving expensive labeling budget) does not strictly apply in this offline evaluation setting.
- Furthermore, the R10 (Under the recommended 400-samples-per-round configuration) endpoint in the text appears to have consumed the entire 3,675-sample pool. Thus, the performance gains of SFV might merely result from having more optimization steps or repeated sample access, rather than the residual-guided sampling strategy itself.
- Suggestion: We strongly suggest adding a baseline where S2 is fine-tuned on the full 3,675 samples, under the same model architecture, loss function, and total computational budget (even convergence). This is crucial to isolate and verify the independent contribution of the residual-guided selection mechanism.
3. Misalignment Between Sample Selection Strategy, Optimization Objective, and Downstream Task
The proposed SFV framework selects training samples based on the NOT–FEM relative L2 prediction error and fine-tunes the surrogate using MSE with teacher anchoring. However, the primary role of the surrogate in this pipeline seems to be rank candidate structures, rather than merely predict their stress–strain (SS) curves accurately.
The authors' own results reveal a discrepancy between prediction accuracy and ranking performance. Although the S1 Adapter achieves a lower OOD prediction error than S2+SFV ( vs. ), it exhibits worse within-cell Spearman correlation ( vs. ) and Top-1 FEM-valid rate ( vs. ). This partly indicates that minimizing pointwise prediction error does not necessarily lead to better candidate ranking.
This raises two critical questions regarding the design of the SFV loop:
- Why does SFV prioritize samples with large prediction residuals rather than those causing incorrect candidate rankings?
- Why is the surrogate trained solely with a pointwise regression objective (MSE) instead of explicitly optimizing for ranking quality?
Suggestion: I recommend including comparisons with ranking-error-based sample selection (e.g., selecting samples that cause the most within-cell ranking inversions) and MSE combined with a pairwise/listwise ranking loss (e.g., Margin Ranking Loss or ListNet), under matched training data and computational budgets. Evaluating prediction error, Spearman correlation, and Top-1 FEM-valid rate across these variants would clarify whether the current sample selection and training objectives are truly optimal for the downstream design-screening task.
Questions for authors
How to control pointwise error and pairwise error, as well as their roles and downstream impacts are interesting issues, but the author has not studied them in depth.