- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes SGCR for continual crystal formation-energy prediction with limited historical memory. It combines structure-guided replay with gradient-conflict correction and evaluates the approach on three datasets and three backbones.
Critical strengths
The evaluation covers complementary distribution shifts and multiple architectures. The method combines targeted replay with historical coverage while preserving a fixed inference architecture. Reported accuracy improvements and novelty-control experiments provide promising initial evidence.
Critical weaknesses
-
Unclear practical motivation. The restrictive 500-record memory budget is not sufficiently justified. It is unclear whether the method remains advantageous when simpler replay methods can retain more historical data.
-
Insufficient explanation of the mechanism. Although the structural features are learned, the connection between structural similarity, novelty, and forgetting is not convincingly established. The paper needs stronger evidence that structure provides useful information beyond gradient conflict.
-
Limited experimental scope. All experiments concern formation energy and short sequences of domains. This provides limited support for the broader applicability to continual crystal property prediction.
-
Limited methodological novelty. The method appears to be an incremental combination of existing replay and gradient-correction ideas. The benefit of this complexity over simpler alternatives is not sufficiently demonstrated.
-
Concerns about experimental reliability. Missing implementation details and uncertainty estimates make the results difficult to assess and reproduce. Figures 3 and 8 are also nearly identical despite reporting different backbones, which requires clarification.
Questions for authors
-
What practical constraint motivates the small memory budget, and would larger-buffer random replay achieve comparable results?
-
What evidence shows that structural similarity or novelty predicts forgetting beyond the gradient-conflict signal?
-
Is there evidence that the method generalizes beyond formation energy or remains effective over longer domain sequences?
-
Does the proposed correction outperform a well-tuned constant correction or a simpler adjustment of the replay weight?
-
Can the authors explain Figures 3 and 8 and clarify the experimental configurations and variability across runs?