- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This work studies the problem of identifying the complete phase set from PXRD when weaker phases are covered by stronger phases and the number of phases is unknown a-priori. They introduce a method called PhaseMatcher, where they borrow the idea of autoregressive modeling to jointly model the contributions of all selected phases and the original reference such that those contributions will be calibrated at each step. There is another STOP head to determine when we should end the decomposition. They evaluate on two datasets, PhaseMix-135K and RRUFF, where they improve on both compared to the baselines.
Critical strengths
- The paper's idea is simple but interesting. This paper uses an autoregressive model for phase identification. The model identifies one phase at a time and revisits previously estimated contributions, helping reduce residual distortion and identify weak phases that were previously missed.
- This method is fast and can be scaled up.
- There is a very detailed statistical analysis on the results based on different characteristicsof the given data.
Critical weaknesses
-
In the paper, the XRD are constructed without requiring the selected phases to coexist under realistic physical or chemical conditions. This randomly selected phases may have very different diffraction patterns, making them easy to demix. Although the appendix checks the overlap, more cases on chemically plausible mixtures with similar diffraction patterns would provide stronger evidence of the model’s ability to handle difficult cases.
-
Both benchmarks use synthetic mixtures instead of real samples. The Gaussian noise and background are also relatively small. It remains unclear to me whether the model maintains its performance under stronger noise, more complex backgrounds, or real experimental conditions.
-
Real samples can have strong preferred orientation, amorphous content, or phases missing from the library, which the generator does not model. So it is hard to tell whether the method, or its physics module, works on real data.
-
It is unclear to me whether the model performs better because it revisits earlier phase contributions or because it can adjust the reference patterns more flexibly. The joint scalar baseline only adjusts their intensity. A stronger baseline would also adjust peak positions and widths and compare how accurately it identifies the phases.
-
The external baselines perform surprisingly poorly. XDecomposer (Gao et al., 2026) and PhaseDifformer (Ito et al., 2026) were designed for source separation rather than identification, and PhaseDifformer was re-implemented under a modified protocol.
-
Add comparisons with the similar existing method, XRD-AutoAnalyzer (Szymanski et al., 2021), and with the refinement-based methods such as DARA (Fei et al., 2026) and RADAR-PD (Yadav et al., 2026), which are discussed in the related work but not compared.
Szymanski, Nathan J., Christopher J. Bartel, Yan Zeng, Mouhamad Diallo, Haegyeom Kim, and Gerbrand Ceder. "Adaptively driven X-ray diffraction guided by machine learning for autonomous phase identification." npj Computational Materials 9, no. 1 (2023): 31.
Yadav, Lalit, Yongqiang Cheng, and Mathieu Doucet. "Automated multiphase identification and refinement in powder diffraction using mismatch-tolerant machine learning." arXiv preprint arXiv:2605.12478 (2026).
Fei, Yuxing, Matthew J. McDermott, Christopher L. Rom, Shilong Wang, and Gerbrand Ceder. "Dara: Automated Multiple-Hypothesis Phase Identification and Refinement from Powder X‑ray Diffraction." Chemistry of Materials 38, no. 3 (2026): 1364.
Other related comparisons could be informative.
-
A non-autoregressive multi-label classifier using the same encoder together with a count head. Without this comparison, it is unclear whether the gains come from autoregressive decomposition or simply from a strong encoder trained on 12 million synthetically mixing data.
-
Using more deformation synthesis techniques, such as per-phase shift, strain, and peak-width parameters, similar to Le Bail fitting (Le Bail et al., 1988) or CrystalShift (Chang et al., 2025).
Le Bail, A., Duroy, H., & Fourquet, J. L. (1988). Ab-initio structure determination of LiSbWO6 by X-ray powder diffraction. Materials Research Bulletin, 23(3), 447–452.
Chang, Ming-Chiang, Sebastian Ament, Maximilian Amsler, Duncan R. Sutherland, Lan Zhou, John M. Gregoire, Carla P. Gomes, R. Bruce van Dover, and Michael O. Thompson. "Probabilistic phase labeling and lattice refinement for autonomous materials research." npj Computational Materials 11, no. 1 (2025): 148.
Questions for authors
- Can you test the method on realistic experimental multi-phase dataset? In this paper, the mixtures are synthetic, how does the model perform with much stronger noise? this can be tested on synthetic mixtures even without real experimental data.
- How does the model handle a phase that is not in the library, or intensity changes larger than the ±10% used in training? Does it stop, or pick a wrong phase?
- How are phases selected for mixing? Are they chosen randomly, or are physical and chemical constraints considered? How does the model perform when the selected phases have similar diffraction patterns and strongly overlapping peaks?
- Can you compare with XRD-AutoAnalyzer, or with a subtraction baseline that also fits peak shift and width?
2 comments
Thank you for your responses and clarifications. Overall, I do not consider the technical contribution to be sufficiently significant. I maintain my score.
Response to reviewer At4i
Thank you for your detailed comments. We added the following experiments and explanations.
Phase selection and perturbations. We agree that the original benchmark randomly selects phases without considering chemical coexistence. PhaseMix-135K does not explicitly include preferred orientation, and its Gaussian noise and background are relatively weak. We therefore added PhaseMix-2 with richer perturbations, including preferred orientation, lattice deformation, instrument and sample broadening, stronger backgrounds, and Poisson noise. See Appendix D.10, Tables 32–34.
Peak-position and peak-width fitting baseline. Following XRD-AutoAnalyzer’s iterative fitting-and-subtraction approach, we added and retrained a Scalar baseline that fits peak positions, widths, and intensities. Its Exact-set@1 is 66.97%, compared with 77.15% for PhaseMatcher Greedy. See Tables 1 and 3 and Appendix B.5.
Transfer to measured spectra. Our supplementary file reports results on 91 measured spectra: 70 from DARA and 21 from OPXRD’s HKUST-A subset. These results provide evidence of transfer to experimental data. We use element constraints to narrow the candidates for these evaluations. The HKUST-A comparison is also in Appendix D.10, Table 35.
XDecomposer results. Our measured phase recall is close to the component Top-1 reported in the original paper, but complete-set accuracy is much lower. The numbers are below. See Table 2 in the original paper and Appendix C.3, Table 15 in ours.
The two studies use different evaluation protocols. Low Exact-set accuracy does not mean low component-level accuracy, because complete-set identification requires every phase and the phase count to be correct.