- Rating
- 4
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper presents an 8B open-weight vision-language model (VLM) for macro placement in VLSI named PlaceReasoner-Pro, to introduce a performance-wise comparable alternative to the proprietary frontier models. This model is trained in multiple supervision stages, ranging from geometric checks to PPA optimization. The authors describe their supervision stages in detail, thereby introducing a synthetic placement environment and associated 10K-SFT/2K-RL training corpus that teaches transferable geometric placement reasoning without proprietary design data. This enables them to minimize costly use of OpenROAD for EDA during the reinforcement learning stages. The paper's experiment section evaluates the training results stage-wise, isolating the contribution of each stage. Additionally, they compare their model against Claude Opus 4.8 using the same harness and achieve comparable PPA results.
Critical strengths
-
They target the major problem of confidentiality issues raised by the use of proprietary frontier models, which are externally hosted, by presenting a comparable alternative based on an open-weight model.
-
By creating a synthetic environment for their first reinforcement learning stage, they can largely reduce the computational effort compared to a full EDA environment. This allows them to train the model on the geometric checks much faster.
Critical weaknesses
- After the paper highlights the monetary cost of using proprietary frontier models as a weakness, it does not evaluate its model costs, such as its cost per design.
Questions for authors
- Can you provide any details about the average power consumption or cost per design?
2 comments
Thanks
Thanks for replying to my queries and explaining further. My rating can hence be maintained as is.
Cost per design: measured GPU energy and per-task cost (App. A.8)
Q1 / W1: Cost per design.
Thank you for the positive assessment and for raising the cost question. We agree that cost should be reported alongside our critique of proprietary models, and we have added this analysis to the revised paper ([Appendix A.8]).
Summary. PlaceReasoner-Pro uses 0.0844 kWh of GPU energy per task on average. At the U.S. average commercial electricity rate (~0.145 USD/kWh), this costs about 0.01 USD in GPU electricity (about 0.025 USD including the idle draw of a dedicated GPU). By comparison, frontier-model placement has been reported to cost about 310 USD per design in API tokens (Kahng et al., 2026). PlaceReasoner-Pro therefore runs entirely on-premises at a small fraction of that cost, while achieving timing comparable to Claude Opus 4.8 under the same harness.
Measurement. Hardware: 8× NVIDIA RTX 6000 Ada (48 GB, 300 W cap), the same server used for all PlaceReasoner-Bench runs. The model is served by vLLM 0.26 with one full BF16 replica per GPU, so each request runs on one GPU. We calibrated on 18 single-stream requests (3 repeats of 6 types: 512/1024-token decode, 8K/16K text prefill, image+text prefill, image + 8K text + 512-token decode). Every prompt and image was unique, so there were no cache hits. Each request was attributed to the GPU whose vLLM token counters rose by exactly that request's usage, and that GPU's instantaneous power (10 Hz) was integrated above its idle baseline over the request window plus a 2.5 s tail. We fit E = e_p · prompt + e_c · completion (least squares, no intercept).
± is the standard error of the fit. A completion token costs about 98× a prompt token: prefill is compute-bound and batched over the prompt, while decoding is memory-bandwidth-bound (each token reads all 17.5 GB of weights, so the GPU runs near its 300 W cap at ~48 tok/s).
Energy per task. LLM energy = e_p · prompt + e_c · completion, the GPU energy that model calls add above idle. + Idle GPU adds one GPU's idle draw over the task's full wall-clock runtime, i.e., the cost of reserving a dedicated GPU, including the time it waits while OpenROAD runs.
The whole 16-task suite uses 1.351 kWh of LLM GPU energy (fit standard error ±0.008 kWh). Completion tokens are 12% of the tokens but 93% of the energy.
We hope these responses address your concerns, and we are happy to answer any further questions during the discussion period.