- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes MOCA, a diffusion-based framework that decomposes classifier-free guidance as a sum of per-concept contributions. which allows concept-wise probing and helps with visual counterfactual explanations.
Critical strengths
The method provides an appealing and simple way to get per-concept control over image content without training a dedicated model.
Critical weaknesses
- Experiments. Important baselines like DVCE or RCSB are missing (while cited in the related work). The included baselines were re-run, and their results fall far below published numbers on the same class pairs. Against published baselines results, MOCA's flip rates for example, are below ACE, RCSB and MaskDiME on all three parts. And even in the paper's own Table 4, MOCA does not clearly outperform ACE.
- From presented visual examples, the counterfactuals look more like adversarial examples. I don't find changes produced by MOCA in neither figure 4 or 5 to be meaningful. For example in Figure 4 sorrel -> zebra, MOCA only makes the color of the horse a bit more bleak not making it an actual zebra (while TIME at least puts line pattern on it).
Questions for authors
- Why were the baselines re-implemented on your generation trajectory instead of being evaluated in their original settings? Can you compare MOCA against the published numbers under the ACE protocol, and add DVCE and RCSB? Which classifier is explained?
- How is the flip rate defined for VCE? Fig. 5 marks flips as successful with a target probability of 0.01. Is success top-1 over all 1000 classes, or a comparison within the class pair?