- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces SartorAI, a framework for garment generation with multimodal conditioning. It proposes a two-stage approach that combines a trained autoregressive model for generating tokenized panel geometry with geometry-conditioned flow modeling for generating stitching relationships. The paper also introduces GCD-Verse, a dataset containing text annotations and instruction-based editing pairs.
Critical strengths
- A novel two-stage framework for garment generation that combines language-driven geometry generation with flow-based topology modeling. The experimental results demonstrate that the proposed method outperforms existing approaches.
- A large dataset that provides a useful resource for the research community.
Critical weaknesses
- While the results are promising, the motivation for generating panels and stitching information in two separate stages remains unclear. Since the second stage takes only the panels generated by the first stage as input, could the model instead generate stitching information immediately after the panels within a single stage? Further discussion of this design choice or additional ablation studies would strengthen the paper.
Questions for authors
- Could the authors provide more garment editing results? For example, it would be useful to see successive edits to sleeve length through repeated instructions such as "make the sleeves longer."
- Could the authors provide more complex generation examples, such as those using a real image as input, similar to the example in Figure 7(f)?
5 comments
Q2: Generalization to Challenging Real-World Garments
SartorAI generalizes to a range of complex real-world garments and stitching structures and achieves higher geometry and topology prediction accuracy than existing methods, but can fail on particularly challenging poses or topologies.
We collected additional Internet images covering a design combining shoulder straps with off-the-shoulder bands (case 4), addressing the reviewer's request for examples similar to Figure 7(f), as well as challenging poses (cases 8, 9, and 12) and complex garment structures (cases 6, 7, and 11). We performed inference, simulation, and rendering with SartorAI, AIpparel, ChatGarment, GarmentGPT, and Joint-VLM (the GarmentGPT comparison was added at reviewer PnhL's request). These comparisons are shown in challenging_wild_img_comparison.png in the supplementary material. These qualitative comparisons expose limitations on particularly difficult examples. In particular, none of the models successfully reconstructed the design in case 4 highlighted by the reviewer. Similar designs account for too small a proportion of the training dataset, so the models have not adequately learned this stitching pattern. Nevertheless, SartorAI retains advantages over the other models.
Further improving the accuracy of panel generation and garment design requires more diverse training data that better reflect real-world garments. Collecting such data is an important direction for our future work, and we expect increasing both data scale and diversity to further improve generalization. Our representation supports this direction because it does not impose priors on panel-edge parameterizations or stitching topology, allowing it to accommodate a broad range of sewing-pattern data.
Dear Reviewer ZoRm,
Thank you for your thoughtful review and your positive assessment of our framework and dataset. With the discussion deadline approaching, we wanted to briefly follow up on our rebuttal.
In response to your suggestions, we have included a Joint-VLM comparison to evaluate our two-stage design, successive editing demonstrations, and additional comparisons on challenging real-world images. We would welcome your feedback on whether these results sufficiently address your questions, and we remain available to clarify any outstanding concerns.
We appreciate your time and the opportunity to improve our work through this discussion.
Best regards,
The Authors
We thank the reviewer for recognizing the strengths of our algorithm design and dataset construction, and for raising constructive questions. We address the weaknesses identified by the reviewer and respond to their questions point by point.
W1: Effectiveness of Decoupling Geometry and Topology
In response to the reviewer's request, we introduce a joint modeling variant, Joint-VLM, that predicts both panel geometry and stitching relationships. The new comparison shows that SartorAI's decoupled framework achieves more accurate stitching topology prediction. We have added qualitative and quantitative experiments to the revised main text and reproduced the quantitative results in
Table 1of the General Response.Joint-VLM uses the same Qwen3-VL-8B backbone and token representations for panel shape, scale, and 3D pose as SartorAI, and reuses the same frozen shape and RT RQ-VAEs. Both models are trained and evaluated on GCD-Verse. Within a single autoregressive sequence, Joint-VLM first generates the geometry of all panels and then their stitching relationships. It also discretizes panel boundaries into points, but explicitly tokenizing every pointwise connection would produce excessively long sequences (approximately 2k stitching tokens per garment on average). We therefore use a simple lossless compression scheme that represents each seam as a pair of contiguous boundary intervals. Each interval is described by three tokens: the panel index, starting-point index, and number of consecutive points. A single direction token specifies the traversal directions of both intervals; together with a seam marker, each seam requires eight tokens. These tokens, along with markers delimiting the complete stitching sequence, are added to the vocabulary. During decoding, the two intervals are expanded into stitching point pairs by matching their relative positions. Like our flow-based representation, this encoding defines stitching relationships between sampled boundary points without imposing priors on panel-edge parameterizations or stitching topology.
Joint-VLM and SartorAI achieve nearly identical Panel CD scores of 1.823 and 1.824 cm, respectively, but their Stitch F1 scores are 0.699 and 0.896, giving SartorAI an absolute improvement of 0.197. This substantial difference in stitching accuracy, despite a shared backbone and geometry representation and nearly identical boundary reconstruction CD, supports the effectiveness of a dedicated geometry-conditioned topology predictor and provides more direct evidence for our decoupled design.
Q1: Successive Garment Editing
We appreciate this insightful question. SartorAI supports multi-round garment editing. We present some results in the supplementary material
successive_edits.png.The supplementary figure presents five examples, each with two successive editing rounds. The first addresses the reviewer's request by demonstrating progressive sleeve lengthening through successive instructions to make the sleeves longer. The second demonstrates editing across garment components: first shortening the top, then lengthening the skirt. The third and fourth examples show successive increases in skirt length and trouser length, respectively. The fifth demonstrates stable results across successive changes to the neckline.
In future work, we plan to extend SartorAI to an agentic loop supporting multi-round editing, collaboration among multiple agents, and automated iterative refinement. Although the current model design and training do not yet implement this full agentic workflow, the model already supports basic multi-round editing.