- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents SimGarment, a feed-forward framework for reconstructing garment sewing patterns from a single image. The method integrates differentiable cloth simulation into network training, enabling gradients from 3D Chamfer and 2D silhouette losses to supervise sewing pattern prediction. By combining synthetic data with annotated sewing patterns, real-world 3D scans, and in-the-wild RGB images, SimGarment reduces its reliance on explicit pattern annotations and achieves promising reconstruction results on the CloSe and 4DDress datasets.
Critical strengths
Integration of Differentiable Simulation. Unlike SewFormer, which relies on ground-truth sewing patterns, or Dress-1-to-3, which requires test-time optimization, SimGarment uses differentiable simulation to propagate geometric errors to the pattern prediction network. Its use of harmonic coordinates enables gradients to flow from simulated garments to panel contours, providing an effective technical solution.
Flexible Training with Heterogeneous Supervision. By combining synthetic sewing pattern annotations, real-world 3D scans, and 2D silhouette supervision, SimGarment reduces reliance on synthetic training data and improves its applicability to real-world garments.
Critical weaknesses
Insufficient ablation of differentiable simulation. The paper's main contribution is integrating differentiable simulation into network training, but the ablations mainly focus on data sources and regularization terms. A comparison with a baseline trained on the same data without differentiable physics supervision is needed to isolate its contribution. Moreover, it remains unclear whether simulation gradients can optimize discrete stitching topology or only continuous panel geometry.
Lack of quantitative evaluation of sewing patterns. The evaluation primarily relies on the Chamfer Distance of reconstructed 3D garments, which does not necessarily reflect the correctness of the predicted 2D sewing patterns. Additional metrics for panel geometry accuracy, stitching correctness, and sewing validity would better support the paper's claims.
The reported inference speedup is unclear. The reported inference time of less than 0.1 seconds appears to cover only sewing pattern prediction, excluding the subsequent sewing and draping simulation. The authors should clarify the end-to-end runtime and ensure that the speed comparison with Dress-1-to-3 includes equivalent processing stages.
Missing Collision Evaluation. Although the method incorporates body-contact constraints through differentiable simulation, the paper lacks quantitative evaluations of garment-body penetration or collision. Such evaluations would provide stronger evidence for the physical plausibility of the reconstructed garments.
Questions for authors
Unclear training and evaluation data splits. Section 6.1 states that CloSe and 4DDress scans are used for training, while Section 6.4 evaluates on the same datasets. Could the authors clarify the train/test splits, particularly whether test garments, subjects, and adjacent scan frames are strictly disjoint from the training data?
Sewing pattern accuracy and validity. Could the authors provide quantitative evaluations of the predicted sewing patterns, including panel geometry accuracy, stitching correctness, and sewing validity, beyond the Chamfer Distance of reconstructed 3D garments?
End-to-end inference efficiency. Could the authors report the complete pipeline runtime and clarify whether the comparison with Dress-1-to-3 covers equivalent processing stages?
Physical plausibility of reconstructed garments. Some results in Figure 1 appear to exhibit garment-body interpenetration. Could the authors provide quantitative collision or penetration metrics to further validate the physical plausibility of the reconstructed garments?
5 comments
Response to Reviewer bru5 (2/2)
Q3. End-to-end inference efficiency. Our reported runtime of under 0.1 s refers to sewing-pattern prediction without per-image optimization. We additionally report the runtime through sewing and draping, with an SMPL body fit provided:
\text{Stage} & \text{Time (s)} \\\\ \hline \text{Sewing-pattern prediction} & 0.027 \\\\ \text{Pattern/stitch conversion} & 0.023 \\\\ \text{Meshing, body initialization, and solver setup} & 1.243 \\\\ \text{Sewing and draping} & 5.013 \\\\ \text{Output-coordinate transforms} & 0.003 \\\\ \hline \text{Total with body fit provided} & 6.339 \end{array}$$ All runtimes are tested on a single A100 GPU; body estimation is excluded. Even including sewing and draping, SimGarment takes approximately 6.34 s, compared with the approximately two hours of per-image garment optimization reported by Dress-1-to-3. We will separately report sewing-pattern prediction and garment-reconstruction runtimes, and explicitly state the hardware and included processing stages in the revision. **Q4. Physical plausibility of reconstructed garments.** We quantify garment–body interpenetration as the percentage of garment surface area located more than 1 mm inside the body, averaged over evaluation scans. Using identical body fits and evaluation protocols for all three models, we obtain: $$\begin{array}{lrr} \text{Model} & \text{CloSe + 4D-DRESS (32 scans)}\downarrow & \text{THuman2.0 (114 scans)}\downarrow \\\\ \hline \text{Released SewFormer} & 0.139\\% & 0.500\\% \\\\ \text{Synthetic-only fine-tuned SewFormer} & 0.449\\% & 0.469\\% \\\\ \text{SimGarment} & 0.099\\% & 0.410\\% \end{array}$$ SimGarment achieves the lowest penetration on both benchmarks. We acknowledge that small residual interpenetration remains, as in some Fig. 1 results. We will include these quantitative metrics in the revision.Response to Authors
The new experiments show that synthetic-only fine-tuned SewFormer already achieves strong sewing-pattern accuracy, with relatively modest further improvements from SimGarment. Therefore, I remain concerned that the specific contribution of differentiable simulation supervision has not been sufficiently demonstrated.
Response to Reviewer bru5 (1/2)
Q1. Training and evaluation data splits. For CloSe, we use 1,416 training scans and 27 evaluation scans. Subjects are shared between the splits, with training and evaluation scans captured in different poses. For 4D-DRESS, the 3D-supervision split uses 27 training subjects and five evaluation subjects with distinct subject IDs and outfits. Evaluation uses one fixed frame per subject. To additionally assess generalization to unseen subjects, we evaluate on 114 THuman2.0 scans without using THuman2.0 for training. SimGarment achieves a Chamfer distance of 1.660 cm, compared with 1.763 cm for released SewFormer. We will explicitly document the split units and counts in the revision.
Q2. Sewing pattern accuracy and validity. We directly evaluate predicted sewing patterns on 186 SewFactory designs excluded from fine-tuning, with two poses per design and identical original renders for all models:
\text{Model} & \text{Panel-count acc.}\uparrow & \text{Edge-count acc.}\uparrow & \text{Panel-shape L2 (cm)}\downarrow & \text{Stitch F1}\ \uparrow \\\\ \hline \text{Released SewFormer} & 91.67\\% & 97.94\\% & 3.733 & 96.12\\% \\\\ \text{Synthetic-only fine-tuned SewFormer} & 95.97\\% & 99.59\\% & 2.268 & 98.96\\% \\\\ \text{SimGarment} & 98.39\\% & 99.61\\% & 2.188 & 99.34\\% \end{array}$$ SimGarment improves panel geometry and stitching correctness over both baselines. For practical sewing feasibility, all three models produce sewn and draped outputs for all 32 reconstruction cases under the same evaluation protocol. SimGarment also achieves lower penetrating garment area: 0.099%, compared with 0.139% for released SewFormer and 0.449% for synthetic-only fine-tuning. We will include these results in the revision.