- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper solved the fairness problem from the denoising process. The authors developed a trajectory level debiasing framework for fair text to image generation. More specifically, they formalized the trajectory level fairness as a balanced assignment problem which compute a soft assignment matrix over different attributes. This problem then was solved using Sinkhorn algorithm. The experiments verified the effectiveness of the proposed method in improving demographic balance while preserving generation quality compared to four representative diffusion architectures. The authors listed the limits of this method in time complexity and memory consumption and proposed it as a future work.
Critical strengths
This paper is well written and easy to follow. The authors presented the idea well. The background introduction is complete, the math part (the optimal transport problem, the Tweedie’s denoising estimator are well-known) is correct, and the experiments and ablations studies are organized very well to show the advantages of the proposed method in improving fairness while preserving prompt semantics and image quality compared to existing baselines and the limits of this method in time complexity.
Critical weaknesses
The main weakness, as the authors pointed it out already, is that this method increases the inference time by approximately 6 times and peak memory usage by approximately 1.5 times relative to base generation.
There are also some minor issues: 1.The link can not be opened: https://anonymous.4open.science/ r/Just_As_Fair/. 2.It should be a full stop . instead of , in equation 3 since this sentence ends there. 3. It should be a , in Equation 7. 4. In proposition 1, “thus the balanced exploration loss provides a upper...”---> an upper 5.Under the table 5, there is a sentence “and training lightweight estimators to for more...”, I think you mean “estimators for more...” in this sentence.
Questions for authors
1.The proposed method looks quite similar to the idea in Balanc. Act, and In Table 2, it seems that Balanc. Act has a better fairness value than the proposed method in the Race column, can you explain why. 2.Can you compare Balanc. Act with the proposed method in other DM frameworks except SD v1.5 and attributes except the gender and race. The authors may need more experiments and comparison between these two to convince the readers that the proposed method is better than the other one except saying in the paper: “ while the best performing baseline, Balancing Act, requires substantial additional training at the cost of prompt alignment.