- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
In this paper, the authors proposed a method called T-MOG for generative models which treats a multi-objective guidance problem as temporally ordered optimization process based on stage-wise effectiveness along the generation trajectory. They also proposed a cross stage objective protection mechanism that solve the problem of two conflicting objectives. Experiments showed that the proposed T-MOG method has better PickScore and SigLIP compared to baseline, DyMO, FMRG, and rewardFlow.
Critical strengths
The structure of the paper is well-designed and the idea is clearly expressed to the readers. The experiments support the authors' viewpoint about the proposed method: stagewise reward optimization works better than reward fusion.
Critical weaknesses
The idea of switching rewards temporally is not new and there are many similar works, for example, DyMO, MULTITUNE: PHASE-AWARE MULTI-OBJECTIVE TUNING FOR DIFFUSION MODELS.
The claimed cross-stage objective protection mechanism in section 2.3 is also a well-known optimization technique. The proposed method is more like empirical and it has no theoretical promise that it is better. I am worried that it is hard to be generalized.
It is hard to get any information from figure 4. Figure 5 and 6 is a little bit confusion and need more explanation. The Rank column in Table 1 is also confusing, does it mean with lower values ranked better. My understanding is that Rank=1 means the Ours beats all the others.
Some minor issues: 1.In line 191, before “where m denotes”, it should be a comma. 2.Equation (8) ends with a comma because the sentence is still going on. 3.In Line 429, “LVM judge”, what is the full name of LVM, also MLLM. I guess it is language-visual-model, and multimodal-large-language model. But it is always better to write the full name at the first position it appeared.
Questions for authors
In this article, the autos only considered the case for two objectives, what if there are more than 2 objectives, like semantic alignment, perceptual fidelity, localized grounding, object consistency, human preference and so on at the same time. Can this method be generalized easily and will it still have better performance compared to the baselines? More experiments may be needed to prove the efficiency of the proposed method.