- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes MR-VTON, a mask-free multi-reference virtual try-on method for in-the-wild scenarios built on Qwen-Image-Edit, which combines adaptive main-reference garment selection (token-level attention pooling with inter-image gating, soft routing during training and hard top-1 selection at inference) and target-pose-guided feature aggregation (multi-layer cross-attention with target pose queries, reference pose keys, and reference content values, augmented by segment embeddings and 2D RoPE), with both branch outputs concatenated and injected into a diffusion transformer. The authors also introduce MRG-4K, an in-the-wild multi-reference VTON benchmark.
Critical strengths
It addresses a practically relevant but underexplored setting. The focus on in-the-wild multi-reference garment images is more realistic than the fixed-view, in-shop setting used by many earlier VTON methods.
Critical weaknesses
1) Insufficient validation of MR-VTON's effectiveness and its generalization to real-world multi-reference datasets. Since the benchmark uses synthetically generated try-on edited images as inputs and video frames as ground truth, MR-VTON's high performance may partly reflect its adaptation to artifacts or stylistic biases introduced by the editing model (such as boundary blur, residual textures, or color biases), rather than genuine virtual try-on capability. This may limit its generalization to real-world inputs with multiple reference garment images.
2) The validation and analysis of whether MRG-4K can truly be used for the multi-reference try-on task are insufficient. Following from the above issue, could the artifacts or stylistic biases introduced by the editing model (such as boundary blur, residual textures, or color biases) be mistakenly treated by try-on methods as garment edge masks? Can such edited MRG-4K truly be used for multi-reference try-on methods? The authors should conduct further validation and analysis on this matter.
Questions for authors
- Insufficient validation of MR-VTON's effectiveness and its generalization to real-world multi-reference datasets. The proposed benchmark relies on synthetically generated try-on edits as inputs and video frames as ground truth. Consequently, its high performance may not fully reflect the model's genuine virtual try-on capability, but could partly result from adapting to artifacts or stylistic biases introduced by the image-editing model used to construct the benchmark. For example, if all test inputs are generated by the same editing model, they may contain consistent boundary blur, residual textures, or color biases. MR-VTON may learn to correct these specific artifacts and perform well on the proposed benchmark, while generalizing less effectively to real images containing multiple reference garment images. The authors should evaluate MR-VTON on additional real-image benchmarks to determine whether the reported improvements persist beyond this synthetically constructed benchmark. Datasets such as DeepFashion, MPV, and Eevee may provide useful complementary evaluation settings. In particular, Eevee appears especially relevant because it provides a setting closer to realistic multi-reference try-on. The authors should clarify how each dataset is adapted to the multi-reference setting and report results on suitable external benchmarks.
2) In Table 2 (Quantitative Comparison), the only compared method with multi-reference input is MV-VTON. To my knowledge, several recent works take multiple reference garments as input for try-on, such as Robust-MVTON (CVPR 2025) and VC-VTON (TIP 2026).
3) Figure 2 should include more technical details to provide a clearer understanding of MR-VTON.
3 comments
Q2:
Thank you for your valuable suggestion. We agree that comparisons with recent multi-reference VTON methods are important for a comprehensive evaluation. We would like to clarify the following points:
(1) Availability of Existing Methods. We acknowledge the relevance of Robust-MVTON (CVPR 2025) [1] and VC-VTON (TIP 2026) [2]. However, to the best of our knowledge, their official implementations and pretrained checkpoints are not publicly available, making it difficult to reproduce their results under our MRG-4K evaluation protocol.
(2) Additional Comparisons with Recent Methods. To address this concern, we have conducted additional experiments with three recent VTON methods, RefTon [3], OmniVTON [4], and Any2AnyTryOn [5], on our MRG-4K benchmark. The quantitative results are presented in Table R2 below. Our method achieves the best performance on four out of five metrics. In particular, compared with RefTon, MR-VTON reduces FID from 25.28 to 21.79 (13.81%) and KID from 22.79 to 16.47 (27.73%), while improving DiffSim from 0.7713 to 0.8014. These results further demonstrate the effectiveness of our proposed approach compared with recent VTON methods.
Table R2: Comparison of Our Method with Other State-of-the-Art Methods.
| Method | FID ↓ | KID ↓ | LPIPS ↓ | PSNR ↑ | DiffSim ↑ |
|---|---|---|---|---|---|
| Any2AnyTryOn | 27.54 | 37.84 | 0.2133 | 17.80 | 0.7709 |
| OmniVTON | 27.90 | 24.81 | 0.2413 | 17.09 | 0.7558 |
| RefTon | 25.28 | 22.79 | 0.2238 | 17.86 | 0.7713 |
| Ours (MR-VTON) | 21.79 | 16.47 | 0.2213 | 18.14 | 0.8014 |
Q3:
Thank you for your valuable suggestion. In our original submission, Figure 2 was primarily intended to illustrate the core architecture of MR-VTON. To provide a clearer understanding of the technical details, we have uploaded a revised architecture diagram in the revision, with the following three improvements:
(1) Routing Strategy. We explicitly illustrate the different routing strategies adopted during training and inference. Specifically, soft routing is employed during training to enable continuous gradient propagation, while hard Top-1 routing is adopted during inference to select the most informative reference.
(2) Segment Embedding. We clarify that the garment content features and pose features extracted from multiple reference images are augmented with segment embeddings after encoding. These embeddings enable the model to distinguish features originating from different reference images, facilitating effective multi-reference feature aggregation.
(3) Feature Integration. We further clarify how the outputs of the two complementary branches are integrated. Specifically, the features produced by the Adaptive Main Reference Selector and the Target Pose-Guided Feature Aggregation module are concatenated and subsequently fed into the downstream modules for virtual try-on generation.
These revisions provide a more detailed illustration of the internal mechanisms and feature interactions, making the overall MR-VTON framework easier to understand.
References
[1] Zhang N, Li Y, Du D, et al. Robust-MVTON: Learning Cross-Pose Feature Alignment and Fusion for Robust Multi-View Virtual Try-On. CVPR, 2025.
[2] Ma, Zhiyuan, et al. VC-VTON: Towards Across-View and Multi-Posture Driven Virtual Try-On via Spatiotemporal-Aware View Consistency Training. TIP, 2026.
[3] Liuzhuozheng Li et al. RefTon: Reference Person Shot Assist Virtual Try-on. CVPR, 2026.
[4] Zhaotong Yang et al. OmniVTON: Training-Free Universal Virtual Try-On. ICCV, 2025, pp. 16702–16711.
[5] Hailong Guo et al. Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Tasks. ICCV, 2025, pp. 19085–19096.
We sincerely thank you for your time and effort in reviewing our paper. Your constructive comments have been very helpful in improving the quality of our work.
As the author-reviewer discussion period will end in approximately one day, we would greatly appreciate it if you could take a moment to review our rebuttal and additional experimental results, and let us know whether our responses have adequately addressed your concerns.
Thank you again for your time and consideration.
W1 & W2 & Q1:
Thank you for your insightful comment. We acknowledge the concern that synthetic editing artifacts may introduce unintended visual cues, potentially affecting the validity of MRG-4K as a multi-reference VTON benchmark. We would like to clarify the following points:
(1) Benchmark Construction and Synthetic Artifact Mitigation. We acknowledge that synthetically edited images may introduce artifacts or stylistic biases. To mitigate this issue, we apply a rigorous data cleaning process during training data construction to filter out low-quality edited images and samples with noticeable artifacts. Moreover, the ground-truth images are original real-world video frames rather than synthetic outputs, ensuring that the model learns to reconstruct realistic garment appearances and textures. More importantly, our evaluations on VITON-HD, DressCode, and StreetTryOn are all conducted in a zero-shot manner using real person images as inputs, without any dataset-specific fine-tuning or synthetically edited test inputs. The competitive results on these established benchmarks provide evidence that our model generalizes beyond synthetic editing artifacts and can effectively handle real-world virtual try-on scenarios.
(2) Real-World Multi-Reference Evaluation on Eevee. To further validate the generalization ability of MR-VTON, we conduct additional zero-shot experiments on the Eevee dataset without any dataset-specific fine-tuning. Specifically, within each garment category (e.g., dresses, lower-body, and upper-body garments), we select multiple reference images from the same video frame and a different video frame as the target person image. This produces a multi-reference evaluation setting consisting of multiple reference garment images and a real target person image, without relying on synthetically edited inputs. Following this protocol, we construct 1,000 evaluation samples, including 250 dresses, 250 lower-body garments, and 500 upper-body garments.
As shown in Table R1 below, our method achieves the lowest FID of 21.12, outperforming all eight competing methods, including specialized VTON approaches and recent general-purpose image editing models. In particular, MR-VTON outperforms Nano Banana Pro (22.15), GPT-Image-2 (23.47), and FireRed-Image-Edit (24.37). These results demonstrate that the effectiveness of MR-VTON extends beyond the synthetically constructed MRG-4K benchmark, providing further evidence of its robustness and generalization capability in real-world multi-reference scenarios.
Table R1: Experiments on the Eevee Dataset.