- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces DAT, a framework for evaluating virtual try-on performance. It relies on fine-tuning a VLM to conduct assessments across multiple dimensions. Scores from these dimensions can also serve as training supervision for other virtual try-on models, with the focus on improving the weak aspects of generative models. The paper validates its effectiveness via human rating comparisons and blind evaluation experiments.
Critical strengths
- The research problem has practical application value, and the evaluation dimensions are relatively comprehensive. 2. It verifies that improvements in the evaluator model can positively guide downstream generative models.
Critical weaknesses
- The source of test labels is not clearly stated. Besides, only three teacher models are adopted in the paper, and their capabilities are questionable. Thus, the correctness of such labels is hard to guarantee. 2. The work is more of a comprehensive application of large models. It essentially fine-tunes one VLM using several other VLMs, lacking distinct innovations. 3. The improvement of generative model performance is not sufficiently demonstrated. The score gains need to be interpreted with supporting independent evidence. Moreover, only one generative model is optimized, which is insufficient to confirm that this method generalizes to other models.
Questions for authors
- It is suggested to supplement the annotation pipeline for each dataset. In addition, stronger models may be used for auxiliary annotation to make the results more convincing. 2. The generative model tested in the paper is still a VLM. It would be worthwhile to explore other types of virtual try-on approaches.