- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces DraftCoder, a vision-language model for generating editable, dimensioned multi-view mechanical drawings from part images and textual geometric specifications. The model generates executable Python/ezdxf programs that produce DXF drawings with orthographic views, hidden lines, and native dimension annotations. The authors construct a dataset of 5,233 samples across nine part categories and propose a Hierarchical Drawing-Consistency Reward (HDCR) to optimize drawing quality through reinforcement learning following supervised fine-tuning. Experiments show that DraftCoder substantially outperforms general-purpose vision-language models in DXF generation, view completeness, and annotation quality. Ablation studies further demonstrate improvements from execution-based reinforcement learning, particularly in dimension annotation completeness and layout consistency.
Critical strengths
- Practical and well-defined task. The paper addresses the generation of editable multi-view mechanical drawings with native dimension annotations, going beyond simple geometric outlines. This is a meaningful engineering task that requires coordinating orthographic views, geometric dimensions, and annotation placement.
- Structured dataset and execution-based learning. The authors construct a dataset of 5,233 samples with paired images, geometric specifications, executable programs, and reference drawings. The proposed hierarchical reward explicitly considers geometry, dimensions, and annotation consistency. The ablation results show improvements over SFT alone, particularly in annotation completeness and layout acceptance, supporting the usefulness of execution-based feedback for this task.
Critical weaknesses
- Insufficient experimental comparisons. The main experiments compare DraftCoder primarily with general-purpose vision-language models that have not been fine-tuned for this task. Although the ablation studies demonstrate improvements over SFT, the gains are relatively modest, and some ablated variants outperform the full model on certain metrics. Without stronger task-specific baselines or alternative reward designs, it is difficult to assess the effectiveness of the proposed HDCR.
- Limited drawing quality and generalization evidence. Despite achieving a high DXF generation success rate, DraftCoder obtains a Geometry Fidelity score of only 21.20/100 and a Layout Acceptance Rate of 31.03%, indicating that substantial drawing errors remain. Furthermore, the dataset is constructed from a single CAD program source and focuses on nine predefined part categories, with no cross-dataset evaluation. This raises concerns about the method's ability to generalize to more complex, real-world engineering drawings.
Questions for authors
- Effectiveness of HDCR. The improvements over SFT are relatively modest, and some reward-ablation variants outperform the full model on certain metrics. Could the authors clarify the specific benefits of the hierarchical reward design compared with a simpler weighted reward, ideally through a direct comparison?
- Drawing quality. Despite the high Scorable DXF Rate, Geometry Fidelity is only 21.20/100 and Layout Acceptance Rate is 31.03%. What are the main factors limiting these metrics, and how often do the generated drawings meet practical engineering requirements rather than merely producing valid DXF files?
- Generalization. The dataset is derived from GenCAD-Code and focuses on nine predefined part categories. Could the authors provide evidence that DraftCoder generalizes to unseen part structures or independently sourced engineering drawings, beyond the held-out split of the same dataset?
10 comments
| Q2:Factors Affecting Drawing Quality and Practical Application in Engineering(Q2&W2)
Further analysis indicates that the key factors influencing the performance of these metrics are the precise correspondence of local geometry and the consistency across multiple views. Geometry Fidelity simultaneously evaluates feature matching, contour connectivity, curve distances, and arc parameters, while placing particular emphasis on weaker sub-components. Therefore, even if a drawing has established its overall structure and is expressed across multiple views, deviations in the positions of local line segments, hidden edge correspondence, or arc parameters will still significantly impact the overall drawing score. This metric measures the degree to which fine-grained engineering constraints are met, rather than merely whether the part’s overall shape is represented. Layout Acceptance Rate, on the other hand, calculates the proportion of samples that meet a predetermined relative layout threshold, rather than an average score for drawing readability. When the spacing and relative positions between views deviate from the reference layout, the drawing may fail to meet this threshold even if the individual views remain recognizable. Therefore, professional judgment is required to distinguish between projection relationship errors that affect engineering meaning and layout discrepancies that can be resolved simply by adjusting details such as view spacing. These factors precisely highlight the core challenge of engineering drawing generation: not only must parts be represented, but local geometry, dimensional information, and cross-view relationships must also be coordinated simultaneously. This work incorporates these requirements into the learning process using multi-view data with dimensional annotations and a hierarchical consistency reward, and outputs directly editable DXF files. For results where critical engineering information is already correct, engineers can make minor refinements directly, without having to redraw from scratch.
At the same time, we invited three PhDs with backgrounds in mechanical engineering to independently evaluate 100 samples selected through stratified random sampling. The results showed that 57 samples met the specified engineering representation requirements without any modifications, while another 26 required only minor adjustments to drawing details such as text positioning and spacing between views. These samples could be used without modifying any critical geometric, dimensional, or projection information. These results demonstrate that DraftCoder is not only capable of generating valid DXF files but also provides engineering drawings that are ready for use after minimal refinement, thereby reducing the effort required to create drawings from scratch and organize multi-view and dimensional information.
| Q3:Cross-Dataset Generalization on Data from Independent Sources(Q3&W2)
We supplemented our tests with external datasets from CADExpert (100 models) and gNucleus (30 models), whose CAD models were created using sources different from GenCAD-Code. We preserved the geometry of the source models and generated isometric views, geometric descriptions, and engineering drawing reference answers in accordance with CODE’s standardized specifications. All tests directly used the DraftCoder checkpoints from the original paper, without fine-tuning or other parameter updates on the external data, and followed the decoding settings and evaluation methods of the original experiment.
| Indicators↑ | OURS | CADExpert | gNucleus |
|---|---|---|---|
| Scorable DXF Rate | 86.26% | 95.00% | 63.33% |
| Geometry Fidelity | 21.20 | 20.19 | 11.79 |
| Dimensional Fidelity | 21.85 | 25.21 | 10.90 |
| Complete View Rate | 70.32% | 78.00% | 40.00% |
| Layout Acceptance Rate | 31.03% | 34.00% | 20.00% |
On CADExpert, DraftCoder achieved a DXF scoring rate of 95.00%; its geometric fidelity was close to the industry average, while its dimensional fidelity, complete view rate, and layout acceptance rate all exceeded the results of the CODE test. This indicates that cross-source migration is not only reflected in file executability but also in dimensional representation, multi-view organization, and layout quality—all of which are maintained without the need for training on the target source.
On gNucleus, the tests provide further coverage of the original FreeCAD model sources.The availability rate of DXF files reached 63.33%,the full-view rate and layout acceptance rate were 40.00% and 20.00%, respectively.These results still provide direct evidence that the model can handle parts from another CAD modeling source without the need for fine-tuning with target data.
Dear Reviewer Uc6P,
Reviewer #Uc6P
We would like to thank the reviewers for their thorough review, their recognition of the research value of this work, and their constructive feedback. Your suggestions regarding the validity of HDCR, the quality of engineering drawings, and the model’s generalizability across data sources have helped us further refine our experimental validation and analysis of the results. We have summarized the relevant weaknesses and issues into the following three areas and address each one in turn, supported by supplementary experiments and analyses.
| Q1. Specific Advantages of a Tiered Reward Design Over a Simple Weighted Reward System(W1&Q1)
A1: The core consideration of HDCR is that the quality of geometry, dimensions, and annotations in engineering drawings is interdependent; they cannot fully compensate for one another. Annotations should be based on correct geometry and dimensions; when the annotated object is incorrect, a well-formatted annotation alone should not receive the same level of reward. Therefore, unlike planar weighting—where each component contributes to the reward independently—HDCR uses the quality of upstream geometry and dimensions to modulate the reward for downstream annotations, thereby encouraging the model to simultaneously improve both the annotated objects and their engineering representation. To verify this design intent, we trained a supplementary model, Flat6, which directly sums the six quality components with fixed weights and does not account for cross-component dependencies, and compared it with the HDCR model described in the paper under a unified testing and evaluation protocol.
These improvements are reflected in geometric and dimensional fidelity, annotation quality, and the degree of complete annotation matching, and the layout acceptance rate has also increased. This result is consistent with the design intent of HDCR: rewards must not only evaluate individual quality metrics but also reflect the dependency relationship that “the correct object supports the correct annotation.”