- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents a dataset of simulated transmission spectra for a family of dielectric structures and compares models that predict these spectra from geometry. The focus is on narrow resonances, with numerical validation and experiments examining how adding high-Q training examples affects prediction.
Critical strengths
The focus on narrow resonances is useful, since these are difficult both to resolve numerically and to predict. Providing broadband and adaptively resolved spectra makes this a potentially useful shared resource. The convergence checks and examination of how adding high-Q training examples affects prediction are also welcome.
Critical weaknesses
-
My main concern with the spectral error is whether it tells us that the resonance is at the correct wavelength and has the correct linewidth. From a spectroscopy perspective, getting the shape correct but the peak position wrong can still yield a poor spectrum. Appendix E examines this separately, and the model ranking changes, which makes its limited coverage consequential.
-
Coming from electronic-structure calculations, my first question is how well converged the reference data are, particularly in the most difficult cases. The dense-sampling check stops around , whereas the dataset reaches about 12600. The separate solver-convergence checks are welcome, but median errors may hide problems in precisely the cases the benchmark is intended to study.
Questions for authors
-
Why is the physical-wavelength evaluation in Appendix E not part of the main evaluation using the full set? Similarly, why is the wavelength error in Table 4 calculated only for predictions within 100 nm of the reference? I would like to see statistics across all predictions, together with the fraction falling within the stated tolerances.
-
Can more validation at the upper end of the Q range be shown? For both spectral sampling and solver convergence, I would like to see the larger discrepancies and how they depend on Q.
-
I may be missing something, but I would interpret FWHM error as an error in the physical linewidth. Appendix C instead seems to describe a span on a fixed reference grid. Does this include errors in the predicted physical width? If not, the figure label should make this distinction clearer.
-
I understand the reason for starting with lossless materials, but how much do the narrowest features depend on this approximation? Would wavelength-dependent complex refractive indices substantially broaden them? This would help clarify the connection to the proposed sensing application.
Thank you for the constructive feedback. We now evaluate the full eligible test set, report the larger discrepancies in the high-Q tail, and clarify what the width diagnostic and lossless model measure.
Q1. Table 3 now reports placement-aware RMSE on all 1,805 fine-eligible samples over five seeds, with one deterministic fit for SVR. It also reports unconditional wavelength RMSE on all 2,070 test geometries, so large wavelength errors are included.
The within-100 nm conditional error remains a secondary measure of precision among predictions already close to the reference. Table 7 reports the fraction of scalar predictions within 100 nm and, separately, detection of the broadband minimum within ±50 nm. Appendix C.2 defines both measures and their denominators. The 976 boundary-clipped records omitted from the earlier canonical-grid comparison are included in the new evaluation (Appendix E.2).
Q2. We added checks on 30 high-Q cases, including cases with Q ≥ 8,000. Table 6 reports the median, 90th percentile, and maximum discrepancy within each Q bin (Appendix B.4).
For the order-11/order-17 comparison, these RMSE statistics are 0.1646, 0.4026, and 0.4562. Comparing the interpolated 40-point spectra with fresh production calculations gives 0.0263, 0.1101, and 0.2639. The median sampling discrepancy rises from 0.0193 in the lowest bin to 0.1436 in the highest. These results show why the high-Q tail retains low-reliability flags.
Q3. You are right about this distinction. The diagnostic measures a half-depth span on the reference detuning grid; it does not measure physical FWHM error or use predicted Q to convert the span into a physical width. We now state this explicitly in Appendix C.3 and clarify the historical FWHM labels in the Figure 7 caption. The placement-aware reconstruction does use predicted position and linewidth scaling (Appendix E.1).
Q4. Our lossless model reports radiative Q. Absorption and other losses reduce total Q through the additional decay channels in Equation 21 (Appendix G). Germanium is transparent over 5–8 µm, while CaF₂ approaches its absorption edge near the long-wavelength end of the band (Section 7), so the assumption of modeling it as lossless is reasonable.
Complex, wavelength-dependent indices can broaden and shift the resonances. We have not quantified that effect, as experimental studies are out of this paper's scope.