- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents PhyCAD, a framework for physics-aware text-to-CAD generation that considers both geometric and physical constraints. Its contributions are three-fold: a text-to-CAD dataset, an automated CAD-CAE verifier, and a novel reward mechanism called Hierarchical Balanced Advantage for GRPO. Specifically, the CAD-CAE verifier combines three-step checking, including program execution, geometric checks, and finite element analysis. The Hierarchical Balanced Advantage, which is the most important contribution of this work, is designed to ensure that the output satisfies both geometric and physical constraints. By combining a between-level advantage with a within-level comparison, it effectively mitigates the drawback of flat aggregation of heterogeneous rewards—namely, allowing improvements in individual criteria to compensate for unmet requirements. The authors conducted extensive experiments on both closed-source and open-source LLMs. The results demonstrate the effectiveness of the proposed PhyCAD. The ablation results shown in Table 2 also verify the performance of the hierarchical GRPO.
Critical strengths
The discussion of the drawback of flat reward aggregation in GRPO is insightful. The authors correspondingly propose a solution, namely the hierarchical GRPO. Accompanied by feedback from the CAD-CAE verifier, it ensures that the output satisfies both the geometric and physical constraints.
Critical weaknesses
None
Questions for authors
In Table 2, the authors report results for Geometry GRPO, Physics GRPO, and Hierarchical GRPO. However, they do not provide implementation details for these variants. For example, how many steps each RL stage involves and what the reward formulation is for each stage. In addition, does the training order affect the final results, e.g., physics GRPO followed by geometry GRPO versus the reverse?
2 comments
Follow-up on Rebuttal Clarifications and Additional Experiments
Dear Reviewer WZW5,
Thank you for your positive assessment and for recognizing the value of the hierarchical feedback formulation in addressing the limitations of flat reward aggregation. We appreciate your support for our work.
In response to your questions, we have clarified the objectives used by Geometry GRPO, Physics GRPO, and Hierarchical GRPO, specified their training schedules, and added the reverse-order experiment. Both staged training orders improve after the final Hierarchical GRPO stage, reaching joint feasibility of 42.01% and 40.82%, respectively. We would appreciate your feedback on whether these clarifications and additional results address your remaining questions.
The ongoing discussion also concerns whether PhyCAD makes a meaningful contribution beyond applying the established SFT+GRPO training paradigm. Your review identified the organization of heterogeneous CAD–CAE feedback as an important contribution and recognized the supporting ablation evidence. We would particularly value your assessment of this methodological contribution in light of the additional explanations and experiments.
If you find our responses satisfactory, we would be grateful if you could reaffirm your support for acceptance and reflect your updated assessment in your review and the final discussion. Your perspective on the contribution and the extent to which your concerns have been addressed would be especially helpful.
Thank you again for your time and consideration!
Best regards,
The Authors of Submission 33572
Reward Formulation and Training Strategy Analysis
We sincerely thank the reviewer for the highly positive evaluation and strong recognition of our contributions. We also appreciate your constructive questions and the opportunity to further clarify our method.
(1) Reward formulation. The stage-specific rewards are illustrated in Fig. 3. For staged training, we use the within-level PeerRank term of Eq. (5):
Aistage=λwAi=λw∑kwkrik.
Specifically:
We will further formalize these stage-specific reward formulations with explicit mathematical expressions in the supplementary material.
(2) Training configurations. Table 2 compares two training strategies, both initialized from the same SFT model:
All Hierarchical GRPO stages use 7,000 steps. We also extended training with the individual Geometry and Physics objectives to 14,000 steps, observing no substantial further improvement. This suggests that longer optimization with isolated objectives is insufficient to replace the joint hierarchical feedback. This further validates the effectiveness of our hierarchical reward design over isolated geometric or physical optimization.
(3) Effect of training order. We additionally evaluate the reverse training order (Physics → Geometry → Hierarchical GRPO) under identical training budgets and evaluation settings in Qwen2.5-3B.
Both training orders achieve substantial improvements after Hierarchical GRPO, with only modest differences in final joint feasibility (42.01% vs. 40.82%).