- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a dual-encoder framework for image-to-CAD retrieval, aligning rendered CAD images and parametric command sequences using CLIP RN50, a Transformer-based CAD encoder, and symmetric contrastive learning. On a gallery of 7,629 CAD models, it achieves 69.60% Recall@1 for canonical queries and 67.40% for mixed canonical/altered queries, demonstrating promising cross-modal retrieval performance.
Critical strengths
-
Retrieving editable CAD models directly from visual queries is a meaningful engineering task. The framework is straightforward and computationally suitable for embedding-based retrieval.
-
The evaluation uses a reasonably large held-out gallery and reports strong Recall@K performance. Sequence-equivalent matching appropriately accounts for duplicate CAD command representations.
Critical weaknesses
-
The core image-CAD contrastive alignment closely resembles GenCAD, which already supports image-based CAD retrieval. The paper primarily reformulates this approach for retrieval without substantial methodological innovation. Moreover, Table 2 compares results obtained under different datasets and evaluation protocols, making the claimed improvements inconclusive. Controlled comparisons and ablations are missing.
-
The altered-query experiment mixes canonical and modified images, without reporting altered-only performance or modification severity. Consequently, the small performance drop does not conclusively establish robustness to geometric changes. Furthermore, evaluation is restricted to synthetic CAD renderings, leaving generalization to real drawings and sketches unverified.
Questions for authors
-
Can the authors provide controlled comparisons against GenCAD and representative image-based retrieval baselines using identical query sets, galleries, and evaluation metrics? What improvements can be attributed specifically to the proposed architecture?
-
What proportion of queries in Experiment 2 are geometrically altered? Could the authors report Recall@K separately for altered-only queries, ideally stratified by modification type or severity?
-
How many duplicate quantized CAD sequences occur in the test gallery, and how does exact-instance Recall@K compare with the reported sequence-equivalent metric?
We do not claim contrastive learning itself as our contribution. Sharing a dual-encoder contrastive setup does not make our method a reformulation of GenCAD; the contribution must be assessed through the differences in training, inputs, and representation design.
Our framework jointly optimizes the CLIP RN50 image encoder and Transformer CAD sequence encoder for retrieval. GenCAD first trains its CAD encoder for autoregressive sequence reconstruction and then freezes it during contrastive alignment. Consequently, our framework allows both modalities to adapt to the retrieval objective, whereas GenCAD aligns image representations to a fixed CAD representation.
Our method maps single shaded renders and CAD sequences into a shared embedding space optimized for bidirectional similarity matching. GenCAD instead uses multi-view line drawings and a CAD latent space shaped by sequence reconstruction within a generative pipeline. These constitute substantive differences in the learning formulation.
On the same dataset, our framework achieves 69.60% Recall@1 with a substantially larger gallery, compared with GenCAD's reported 60.77% on 2,048 candidates. These results provide relevant evidence of our framework's retrieval capability. We acknowledge, however, that differences in evaluation protocols prevent these figures alone from establishing controlled superiority.
The limited prior work and differing experimental setups make a common evaluation setting challenging to establish. GenCAD's own retrieval comparison is also limited to a ResNet baseline. We agree that controlled experiments against GenCAD would strengthen the comparison; nevertheless, we believe the reported results support our framework's strong retrieval performance.
As explained in the paper, the mixed-query evaluation was deliberately designed to approximate a practical retrieval scenario in which queries may include both canonical and altered images. The mixture is therefore part of the evaluation design.
Each query view is sampled uniformly from indices 0–4, with only index 0 corresponding to the canonical view. Consequently, the expected proportion of altered queries is 80%. The reported performance therefore predominantly reflects retrieval with altered inputs, rather than a mainly canonical evaluation.
The decrease from 69.60% to 67.40% Recall@1 provides evidence that retrieval performance remains stable under this predominantly altered-query setting. We agree that this aggregate result does not establish altered-only performance or robustness across all levels of modification severity, and our conclusions should be interpreted within the tested conditions.
As explained in Table 1, the test set contains 7,629 images corresponding to 7,609 CAD models, so a small number of models have two valid query images.