- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper builds a benchmark for predicting SEM images of printed lithography patterns from a mask and process conditions (illumination source, defocus, dose). Because real SEM data with dense process labels is hard to obtain, the targets are synthetic: a rigorous lithography simulator produces 3D resist profiles, and a ControlNet trained on real CD-SEM images renders the top/bottom contours into SEM-like images. This gives 547K mask/process/image triplets, split into ID (111 stress-test patterns), Mask-OOD (500 unseen LithoBench masks), Process-OOD (extreme focus/dose) and Source-OOD (an unseen Quasar source). Besides PSNR/LPIPS/FID, a fine-tuned SAM extracts contours from both predictions and targets, from which Dice/B-IoU, gauge-based CD and EPE, and rule-based defect labels are computed. Seven baselines are compared (CNN, Transformer, two FNOs, Pix2Pix, two SD variants). The main message is that good FID or contour overlap can go together with large CD errors and poor defect prediction, especially under process shift. Model rankings are also checked against held-out wafer SEM images.
Critical strengths
-
The metric design is the paper's most valuable contribution. Gauge-based CD/EPE and defect labels, computed with the same extractor on prediction and target, are much closer to how lithography engineers judge outputs than FID or PSNR, and they actually change the ranking: on Process-OOD, SD-Adapter has the best FID but a 55 nm CD error, against 9–11 nm for MFNO and CNN (Table 3).
-
The OOD splits are sensible. Each one moves a single factor (mask, focus/dose, or source) and keeps the rest fixed, so it is clear what a failure means. Having any comparison against real wafer SEM is also more than most simulation-based benchmarks offer.
Critical weaknesses
-
The fabrication metrics that carry the main finding do not behave as expected. EPE stays at 2–4.6 nm while CD error ranges from 9 to 113 nm (e.g., CNN on ID: 2.70 vs. 22.66), which is hard to explain unless a few gauges with bridges or pinches dominate the mean; in that case "good overlap, bad CD" is partly a defect effect rather than a linewidth one. The defect metric does not separate the models on Process-OOD either, where all seven score 0.34–0.36 Status F1 with overlapping CIs (Table 3).
-
The real-wafer validation is thin. Table 4 gives no sample size or CIs, the rank correlations in Sec. 4.2 are computed over only six models, and the main text does not say which process conditions the wafer data cover. So it is unclear whether the Process-/Source-OOD conclusions, which carry the paper's main claims about model families, hold on real data.
Questions for authors
-
How are gauges counted when the prediction has no valid edge pair, e.g., because of a bridge or a missing line? The median CD error, or CD on gauges valid in both prediction and target, would largely settle my first concern.
-
How large is the wafer set in Table 4, and which focus/dose conditions and sources does it cover? If it includes off-nominal conditions, could you report Table 4 per condition with CIs, to show whether the Process-OOD finding (deterministic models keep CD error lower than SD-based ones) also holds on real data?
-
For the Process-OOD defect results, could you add a trivial baseline, such as always predicting "defective" or a model that ignores F and E, to show whether any model does better than chance?
Minor: the Discussion paragraph repeats one sentence, and Yang et al. 2022a and 2022b are the same reference.
6 comments
Response to Reviewer SvEj (2/4)
Response to W1(2) and Q3: Defect Evaluation on Process-OOD
We thank the reviewer for the careful observation regarding the defect evaluation on Process-OOD. We agree that the Status F1 scores of the seven models are closely clustered between 0.340 and 0.356, with overlapping confidence intervals. These results do not provide sufficient evidence to distinguish the models in defect status prediction under Process-OOD conditions.
To address this concern, we evaluated two constant prediction policies on the same Process-OOD test set: Always-Defective, and Always-All-Types. The results are summarized below.
| Method | Status F1 | Type macro-F1 | Type micro-F1 |
|---|---|---|---|
| CNN | 0.354 ± 0.086 | 0.144 ± 0.044 | 0.110 ± 0.035 |
| Trans | 0.340 ± 0.087 | 0.183 ± 0.042 | 0.117 ± 0.034 |
| RFNO | 0.354 ± 0.085 | 0.209 ± 0.039 | 0.161 ± 0.036 |
| MFNO | 0.355 ± 0.085 | 0.183 ± 0.042 | 0.129 ± 0.035 |
| Pix2Pix | 0.347 ± 0.092 | 0.183 ± 0.039 | 0.143 ± 0.036 |
| SD-AdaIN | 0.353 ± 0.120 | 0.222 ± 0.068 | 0.138 ± 0.041 |
| SD-Adapter | 0.356 ± 0.087 | 0.235 ± 0.037 | 0.135 ± 0.035 |
| Always-Defective | 0.2759 ± 0.0244 | N/A | N/A |
| Always-All-Types | 0.2759 ± 0.0244 | 0.0607 ± 0.0060 | 0.0620 ± 0.0062 |
We highlight two findings from these results:
-
(1) All seven models achieve higher Status F1 than the Always-Defective baseline (0.340–0.356 vs. 0.2759), suggesting that they capture defect-related information beyond a constant prediction strategy.
-
(2) Defect Type F1 reveals additional differences among models. On Process-OOD, where the defect distribution is imbalanced, the seven models exhibit closely clustered Status F1 scores (0.340–0.356), while their Type macro-F1 scores show greater variation (0.144–0.235). For example, CNN and SD-Adapter achieve nearly identical Status F1 scores (0.354 vs. 0.356), but different Type macro-F1 scores (0.144 vs. 0.235). This distinction arises because Status F1 evaluates defect occurrence without distinguishing defect categories, while Type F1 additionally evaluates classification across defect types.
These results demonstrate the complementary information provided by Status F1 and Type F1, particularly for challenging datasets with imbalanced defect distributions such as Process-OOD. In future work, we will further expand the coverage of layout structures and process conditions to improve the statistical representation of rare defect categories.
Response to Reviewer SvEj (3/4)
Response to W2(1) and Q2(1): Real-wafer Dataset Clarification and Statistical Results
We thank the reviewer for pointing out that the real-wafer validation in Table 4 (Table 5 in the revised version) lacked sufficient details. We have supplemented the dataset description in the main text.
Specifically, the real-wafer validation uses the test set described in Table 5 (Table 6 in the revised version), comprising approximately 2,000 SEM images across 200 masks. Regarding process-condition coverage, we would like to clarify that deviations from nominal process conditions do not necessarily imply Process-OOD conditions. The test set includes 9 focus levels spanning [-28 nm, 28 nm] and 11 dose levels spanning [20 mJ/cm2, 40 mJ/cm2], all acquired under quadrupole illumination. Although the test set includes off-nominal conditions, all evaluated conditions fall within the predefined Process-ID range.
To address the missing statistical information, we have updated Table 4 (Table 5 in the revised version) to include the corresponding 95% confidence intervals for each evaluation metric. The updated results are presented below.
Held-out Wafer-SEM Evaluation
| Model | B-IoU (Mean) | B-IoU (95% CI) | EPE (Mean) | EPE (95% CI) | CD (Mean) | CD (95% CI) | Status F1 (Mean) | Status F1 (95% CI) |
|---|---|---|---|---|---|---|---|---|
| CNN | 0.689 | ±0.0761 | 3.19 | ±0.5639 | 24.40 | ±3.7193 | 0.771 | ±0.0228 |
| Transformer | 0.648 | ±0.0658 | 3.76 | ±0.5624 | 30.75 | ±2.8690 | 0.674 | ±0.0215 |
| RFNO | 0.660 | ±0.1064 | 3.91 | ±0.4313 | 19.80 | ±3.9713 | 0.802 | ±0.0208 |
| MFNO | 0.670 | ±0.0697 | 3.38 | ±0.5903 | 15.48 | ±2.9961 | 0.818 | ±0.0193 |
| Pix2Pix | 0.682 | ±0.0898 | 3.25 | ±0.7801 | 14.68 | ±3.2730 | 0.849 | ±0.0201 |
| SD-Adapter | 0.691 | ±0.0749 | 3.12 | ±0.8207 | 19.84 | ±10.4555 | 0.867 | ±0.0198 |
Furthermore, we have clarified the Rank Correlation analysis in Section 4.2. The Spearman correlation coefficients quantify the overall ranking consistency of the six evaluated models between FabBench and the real-wafer Process-ID evaluation. To provide a more transparent comparison beyond the correlation coefficients, we have also provided the individual rankings of all six models under both evaluation settings in Appendix G.2, Table 11. This allows readers to directly examine the correspondence between model rankings and identify any changes in their relative ordering.
Response to Reviewer SvEj (1/4)
Response to W1(1) and Q1(1–2): Large CD Errors and Gauge Evaluation
We thank the reviewer for the careful observation regarding the discrepancy between EPE and CD error. We agree that large mean CD errors may be influenced by localized geometric deviations caused by defects such as bridges and pinches. We clarify the gauge evaluation rules and provide additional analyses on the ID dataset to investigate this effect.
Gauge validity and CD calculation. Gauge validity is determined by whether a valid edge pair can be detected along the scanline. In this setting, a bridge may cause the detected edge pair to lie outside the original feature, resulting in large CD errors. We retain such gauges because their CD errors capture defect-induced geometric changes. Specifically, the CD error is calculated as follows:
This protocol preserves measurable defect-induced geometric errors while accounting for missing edge pairs in the predictions.
Additional CD error analysis. To examine the influence of large errors and localized defects, we report the median absolute CD error and the CD MAE after excluding cases affected by feature-disrupting defects, which displace the detected edge pair from the intended feature.
Additional CD error analysis on ID Dataset
As shown, the median CD errors range from 1.278 to 3.178 nm, indicating that large errors in the distribution largely influence the mean. For CNN, the median CD error is only 2.584 nm, compared with its original mean CD error of 22.66 nm. After excluding feature-disrupting defects, its CD MAE decreases to 6.085 nm, a reduction of 73.1%. Across all seven models, the CD MAE after exclusion ranges from 4.966 to 10.852 nm. These results indicate that localized defect-induced geometric deviations contribute to large mean CD errors.
Interpretation of EPE and CD differences. EPE aggregates contour-edge displacement, while CD measures local dimensions using edge pairs along predefined gauge scanlines. Bridges or pinches can alter local topology and displace the measured edges, producing large CD errors even when the remaining contours maintain good agreement with the ground truth. This explains how CNN can exhibit an EPE of 2.70 nm alongside a mean CD error of 22.66 nm.
We agree that large CD errors can reflect both linewidth deviations and defect-related geometric changes. These deviations represent meaningful fabrication prediction errors. Accordingly, CD captures local dimensional variations and defect-related geometric changes at designated gauges, complementing overlap metrics that assess overall geometric agreement and Defect Status/Type metrics that evaluate defect occurrence and classification without directly quantifying geometric severity.
We have added these analyses to Appendix G.1 and further provide qualitative examples in Fig. 5 to illustrate the complementary nature of these metrics in the main paper.