- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SimSew, an RL-based post-training framework that enhances SewFusion with simulation-aware rewards. The paper introduces three categories of rewards and jointly optimizes the network using their weighted combination.
Critical strengths
- The paper is well-written.
- The observation that reference fidelity does not necessarily reflect simulation readiness is interesting and potentially important.
Critical weaknesses
-
The paper introduces an RL-based post-training module built upon the SewFusion architecture. However, SimSew does not consistently outperform SewFusion across all metrics, particularly under the editing setting. It is recommended to investigate setting-specific reward weighting or adaptation strategies.
-
The observation that reference fidelity does not necessarily reflect simulation readiness is interesting and potentially important. It is recommended to supplement additional statistical evidence, including correlation analyses between reference-based metrics and simulation success, together with failure rate statistics for different error types.
-
The paper defines three top-level rewards decomposed into seven sub-rewards. Nevertheless, weighted-sum aggregation of multiple rewards cannot guarantee simultaneous improvements over all objectives. Certain reward terms may be hard to optimize or mutually conflicting, which may cause unstable optimization or unwanted trade-offs. It is recommended to explicitly address such reward conflicts.
-
Moreover, the reward formulation relies on several hand-crafted hyperparameters that can alter interactions between reward components. It is recommended to conduct reward-weight sensitivity analysis and examine potential gradient conflicts or competing objectives in the reinforcement learning pipeline.
Questions for authors
See weekness.
4 comments
Pointwise Response to Reviewer wNCr (Part 2/2)
The paper defines three top-level rewards decomposed into seven sub-rewards. Nevertheless, weighted-sum aggregation of multiple rewards cannot guarantee simultaneous improvements over all objectives. Certain reward terms may be hard to optimize or mutually conflicting, which may cause unstable optimization or unwanted trade-offs. It is recommended to explicitly address such reward conflicts.
A3:
To investigate potential conflicts, we analyze gradient conflicts over 100 RL training steps. At each step, we compute reward-specific policy gradients on the same rollouts, and measure their pairwise cosine similarities. We report the average cosine similarity across the 100 steps.
| Reward Pair | Cosine Similarity ↑ |
|---|---|
| Format vs. Stitch | 0.1063 |
| Format vs. Geometry | 0.0827 |
| Stitch vs. Geometry | 0.1159 |
The results suggest that the three reward objectives are generally compatible. The FlowOPD framework offers a potential direction for further mitigating these conflicts. However, exploring this approach is beyond the scope of the current manuscript. We thank the reviewer for this valuable suggestion and will investigate this direction in future work.
Moreover, the reward formulation relies on several hand-crafted hyperparameters that can alter interactions between reward components. It is recommended to conduct reward-weight sensitivity analysis and examine potential gradient conflicts or competing objectives in the reinforcement learning pipeline.
A4:
Thank you for this valuable and constructive suggestion. We have conducted additional reward weight sensitivity experiments and gradient conflict analyses to address these concerns. Please refer to A1 and A3 for detailed results and discussions.
Thank you for the additional analyses. This additional experiment cannot verify the soundness of compatible objectives or weighting strategy (average cosine similarity of gradients). Given that the pipeline is standard GRPO with some hand-crafted rewards, I remain concerned about novelty and keep my original score.
We thank the reviewer for the thoughtful comment. To the best of our knowledge, SimSew is the first work to apply reinforcement learning to improve the simulation success rate of generated sewing patterns. We argue that the main contribution of our work lies in designing effective rewards to address this challenge. Regarding potential conflicts among multiple rewards, existing works such as FlowOPD offer promising solutions. We plan to explore this direction in future work, as it is out of scope of this work.
Pointwise Response to Reviewer wNCr (Part 1/2)
We are grateful to the reviewer for the insightful feedback, which has helped us improve our work. We address each concern individually below. Unless otherwise specified, the additional experiments on GCD-MM are conducted under the image setting, using 500 training steps and 50% of the dataset for both training and evaluation.
Response to 'Critical Weaknesses':
A1:
We conducted additional reward weight sensitivity experiments under both the image-conditioned and editing settings on GCD-MM. Specifically, we varied the weights of the Pattern-Format, Stitch-Aware, and Geometry-Aware rewards while keeping the random seed and other training configurations unchanged. The quantitative results are presented below.
The results demonstrate that SimSew maintains stable SSR across different reward configurations, with equal weights achieving the highest SSR in both settings. These findings demonstrate the robustness of our reward design to weight variations. Therefore, we retain equal weights across both settings rather than introducing additional setting-specific strategies.
We have included these results in the revised manuscript. (Sec. 5.3, line 519)
A2:
The results show weak-to-moderate correlations, indicating that reference-based metrics are associated with simulation success but do not fully capture simulation readiness.
These results demonstrate that our simulation-aware RL framework effectively reduces both stitching-related and geometry-related failures, further supporting its effectiveness in improving downstream simulation readiness.