- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes STEP-KD for predicting post-routing endpoint slack, and hence circuit-level TNS and WNS, using post-synthesis inputs. Models are trained in reverse design order, from routing through placement and floorplanning to synthesis. Each earlier-stage model aligns node-, subgraph-, and graph-level representations with frozen later-stage models through cascaded projections. Only the synthesis-stage model and its projection cascade are needed at inference. The authors construct approximately 12.2k implementations of 922 RTL designs using OpenROAD and ASAP7, split by source design, and additionally evaluate on OpenLLM-RTL. Experiments compare against synthesis-stage STA, supervised learning without distillation, direct distillation from different stages, and several ablations. The main test-set results favor STEP-KD; the external benchmark shows stronger improvements for aggregate TNS errors than for WNS.
Critical strengths
-
The design-stage hierarchy is a well-motivated structure for privileged-information transfer, and the ablations (independently trained multi-teacher, projection depth) genuinely test that structure rather than just adding capacity.
-
The aligned multi-stage dataset with design-disjoint splits, plus the external OpenLLM-RTL evaluation and multiple error aggregations, makes the evaluation considerably more convincing than a single aggregate score.
Critical weaknesses
-
The reported error bars come from resampling test implementations rather than independent training runs, and the external benchmark excludes five circuits precisely where the baseline is exact. So the robustness and external validity of relatively small gains are not fully established (STEP-KD is already worse than STA on external WNS, 36.55% vs 33.71%).
-
It remains unclear how much of the benefit requires the full graph/distillation pipeline: the Appendix C slack-only ablation nearly matches Direct-KD, there is no comparison to a lightweight endpoint-level correction of early STA, and no failure-screening (false-pass) analysis to support the intended use case.
Questions for authors
-
Were the models retrained across random seeds, or do all standard deviations reflect only the 20 test-mplementation draws? Training-seed variability for STEP-KD vs direct PR distillation would be particularly informative.
-
What do the results look like with the five excluded circuits from Appendix B.2 restored, and is the count of 38 designs / 189 implementations before or after this exclusion?
-
How does STEP-KD compare to a simple supervised endpoint-slack correction model using only synthesis-time information (early slack, cell features, planned density/utilization)? The Appendix C ablation still uses graph representations, so it doesn't answer this.
-
At a stated timing-violation threshold, how often does STEP-KD predict a failing circuit as passing, compared with STA and Direct-KD? Reporting inference time including feature extraction and early STA would also help judge practical utility.
We thank the reviewer for their feedback.
Q1. All standard deviations in Table 1 reflect only the 20 test-implementation draws. We agree that independent training runs would characterize optimization variance more fully. In the revised paper, we have added results on three additional random train/validation/test splits, with all models (including all STEP-KD teachers) retrained on each split (new Appendix H). STEP-KD has the lowest TNS MedAE and TNS WMAPE on all three splits, and the lowest error on 11 of the 18 split–metric pairs. It is also more accurate than direct distillation from the PR teacher on every metric of every split.
Q2. The five excluded implementations are cases where the post-synthesis and post-routing STA values are identical, so the prediction task is trivial. These circuits are "precisely where the baseline is exact", but STEP-KD is also nearly exact on them, because it takes the current-stage STA slack as an input feature (Section 4.2, Appendix C).
We removed these few circuits because they also have extremely large TNS and WNS, so they dominate WMAPE and RSE and inflate the scores of both STA and STEP-KD. The exclusion follows a single criterion, applied uniformly to all methods, that removes trivial, extreme-valued circuits; it is not a hand-picked selection. The table below reports results with and without the excluded circuits. Because both methods are nearly exact on the restored circuits, restoring them lowers WMAPE and RSE for both methods and leaves MedAE essentially unchanged. The counts of 38 designs and 189 implementations are after the exclusion.
Q3. We trained a simple endpoint-level MLP that corrects the post-synthesis timing estimate using only synthesis-time information (the early slack, cell features, and the placement density, core utilization, and clock period), and we have added this new baseline to the paper (Table 1, Section 5.3). It is less accurate than STEP-KD on every metric of both datasets except OpenLLM-RTL WNS MedAE, and on the held-out set it is less accurate than No KD on every metric. This highlights the importance of the graph structure.
Q4. Inference consists of a forward pass through a GCN, which is very fast. Graph parsing is also fast, taking less than 10 seconds on the largest graphs. Compared with the PS → PR flow, which involves search and optimization problems, STEP-KD gives an instant (but approximate) estimate of the timing.
We produce a false-pass table with threshold set to zero. Values below are percentages, mean ± std over the 20 evaluation runs ( lower is better).
The false-pass rate is the fraction of circuits that actually fail timing but are predicted to pass. A circuit fails when its post-routing WNS is negative, meaning that at least one endpoint has negative slack, and it is predicted to pass when its predicted WNS is non-negative (here, exactly 0). On the original held-out set (about 160 failing designs per evaluation run), STEP-KD falsely passes 1.4% of failing circuits. On OpenLLM-RTL, where all 38 designs fail, STEP-KD's rate rises to 14.6%, higher than that of No KD (6.7%) but lower than those of Direct KD (19.6%).
One caveat is that this metric rewards pessimism. STA flags about 99% of circuits as failing and therefore has a 0% false-pass rate, and the models with the lowest rates also predict nearly every circuit as failing (97–98%).