- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper focuses on the CAD generation task and points out that existing heuristic feedback mechanisms do not necessarily translate feedback into effective corrective actions to rectify generation errors. To address this issue, the paper proposes RA-CAD, which organizes CAD generation into a Generate–Execute–Critique–Rewrite loop. Specifically, it generates explicit post-execution critiques to guide subsequent CAD code rewriting.
Critical strengths
- The idea of introducing explicit critiques to improve CAD code rewriting is interesting.
- Figure 3 clearly illustrates the workflow of the Generate–Execute–Critique–Rewrite loop.
Critical weaknesses
-
Introducing the Critique module is a core design of this paper. However, the implementation details of the Critique module appear to be missing. Section 4.1.2 mentions Meta-Llama-3-8B-Instruct as the base model, but it is unclear whether this refers to the Generation module, the Critique module, or both. Moreover, is the entire Generate–Execute–Critique–Rewrite loop jointly trained using the reward described in Section 3.3.3? Is the Critique module trained separately? Furthermore, I would like to better understand the content of the critiques and how they are designed. Although I noticed that the Appendix provides the “Prompt of the Critique Module,” I would still appreciate a discussion of the motivation behind the critique design, along with concrete examples of the critiques generated by the module.
-
The experimental results appear strange, and I would like the authors to provide explanations.
-
The results in Table 1 are strange. In the original papers on Text2CAD [1] and CADFusion [2], the reported invalidity ratios (IR) are very low (below 10%). However, in Table 1 of this paper, the IR are considerably higher: above 60% for Text2CAD and above 20% for CADFusion. This discrepancy is quite strange and needs explanations.
-
In related RL-based CAD generation studies[2][3], the supervised fine-tuning (SFT) stage typically leads to substantial improvements in the invalidity ratio (IR). Similarly, as mentioned in Sections 3.2 and 3.3 of this paper, SFT is intended to teach the model CAD syntax and establish its basic capability to generate executable CAD code. However, in Table 3, the w/o FAO setting, which represents the results obtained using SFT alone, yields an extremely high IR of 90.01%. This suggests that the model still struggles to generate executable CAD code even after SFT, which is counterintuitive. I would appreciate a detailed explanation of this result.
-
-
Some more advanced works[4-6] on CAD generation should be included and discussed in the Related Work.
[1] Text2cad: Generating sequential cad designs from beginner-to-expert level text prompts.NIPS 2024
[2] Text-to-CAD Generation Through Infusing Visual Feedback in Large Language Models.ICML 2025
[3] cadrille: Multi-modal cad reconstruction with online reinforcement learning. Arxiv 2025
[4] CADMorph: Geometry-Driven Parametric CAD Editing via a Plan-Generate-Verify Loop. NIPS 2025
[5] CAD-Tokenizer: Towards Text-based CAD Prototyping via Modality-Specific Tokenization. ICLR 2026
[6] Plan-then-Act: Bi-level CAD Command Sequence Generation. ICLR 2026
Questions for authors
- Please clarify the implementation details of the Critique module.
- Please provide an explanation for the strange experimental results.