- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper tackles the task of "generative" Fashion Outfit Composition (FOC), where a model "sequentially" selects compatible garments from a large library and determines when an outfit is complete. It proposes the Unified Aesthetic Foresight Model (UAFM), which combines a policy head for complementary item retrieval and a value head for evaluating partial outfits. A key contribution is the use of Temporal Difference (TD) learning to propagate sparse aesthetic rewards from complete, human-curated outfits to intermediate partial outfits, enabling the model to estimate marginal aesthetic gains and decide when to stop adding items.
Experiments on Polyvore-Outfits show improvements over adapted composition baselines in aesthetic quality, category consistency, and human preference, as well as competitive results on conventional compatibility prediction and fill-in-the-blank retrieval benchmarks. The ablation studies further suggest that TD-based value learning and the shared dual-head architecture benefit sequential composition.
However, while the reported experiments suggest that the framework is effective for outfit composition, it remains unclear whether the learned stopping behavior reflects genuine aesthetic completeness or primarily captures the construction patterns of human-curated outfits.
Critical strengths
This is the first attempt of a "generative" outfit composition work and experiment results show its effectiveness. Comparisons with existing work on compatibility scoring is also solid.
Critical weaknesses
1. The training supervision does not necessarily reflect aesthetic completeness.
The paper assumes that intermediate subsets of human-curated outfits are aesthetically incomplete and should be further expanded. However, a partial outfit (e.g., a shirt, trousers, and shoes) may already be aesthetically complete, even if the original curated outfit contains additional accessories. The dataset provides supervision on which items belong to a curated outfit, but not on whether adding another item would actually improve its aesthetic quality.
Consequently, it is unclear whether the proposed Temporal Difference (TD) learning framework captures genuine aesthetic saturation, as claimed, or primarily learns the outfit construction patterns and length distribution of the training dataset. This is particularly consequential because autonomous termination based on aesthetic saturation is one of the paper's central contributions.
2. The ablation study does not isolate the contribution of TD learning from partial-outfit supervision.
The key ablation in Section 3.3.1 compares BCE trained exclusively on complete outfits against TD learning that additionally supervises intermediate partial outfits. This changes both the training objective and the states receiving supervision, making it difficult to attribute the observed improvements specifically to TD learning.
A straightforward missing baseline is BCE trained on both complete and partial outfits, keeping the architecture and other training settings unchanged. Without this comparison, the experiments do not establish whether the proposed TD formulation provides benefits beyond simply exposing the model to partial outfits during training. This weakens the experimental support for the paper's main methodological contribution.
Questions for authors
Questions raised in above section.
2 comments
Dear Reviewer,
The discussion period is nearing its end, and we haven’t yet seen a reply from you. We encourage you to respond to the authors’ comments, especially if you have further questions about points that may affect your assessment.
Thank you for taking the time to engage in the discussion.
Best,
Your AC
We sincerely thank the reviewer for acknowledging our work as the first attempt at generative outfit composition, as well as for your insightful observations regarding aesthetic completeness and the isolation of our training objectives. Below are our detailed responses.
Response to Weakness 1
UAFM learns genuine aesthetic saturation through the tension between a constant step penalty and a capped terminal reward, intrinsically penalizing over-composition without requiring explicit intermediate labels. Overcoming the lack of intermediate dataset supervision (no signal on whether adding another item would actually improve its aesthetic quality) is precisely the motivation for our MDP formulation and post-decision state TD learning paradigm.
To explain why UAFM learns genuine aesthetic saturation rather than merely memorizing dataset length distributions, consider how our TD formulation governs both training and inference: During training, positive trajectories terminate with a fixed reward (y=+1.0), while intermediate steps incur a compositional cost (r=−0.1). As an outfit approaches completeness, the marginal value increment naturally diminishes, capping at 1.0. Conversely, negative outfit trajectory yield a terminal reward toward −1.0. Consequently, during inference, when the Policy Head retrieves a candidate item anext to form the augmented state St+1a=Sta∪{anext}, two scenarios naturally emerge:
In both cases, the marginal gain drops below the termination threshold, halting composition. This is validated by Figure 4(b), which shows value predictions plateauing as aesthetic saturation is reached for human-curated outfits. We will clarify this theoretical connection in the revised methodology.
Response to Weakness 2
To explicitly address your concern regarding the isolation of our training objectives, we have provided the complete ablation results—including the exact missing BCE-with-partial baseline you suggested—in our Global Comment. These results reveals that applying a static BCE loss to intermediate states actively degrades downstream performance (e.g., R@10 drops from 11.77% to 8.96%) because coarse binary labels corrupt the decision boundary. Our TD formulation substantially outperforms
BCE-with-partialacross both generative composition (Category Alignment jumps from 59.51% to 78.20%, and Category Duplication drops from 14.09% to 1.29%) and downstream tasks (FITB rises from 66.68% to 70.84%, and R@10 from 8.96% to 12.05%). This confirms that the performance gains are fundamentally driven by the step-wise credit assignment of the TD formulation, not merely from exposing the model to intermediate partial outfits.