- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses compositional failures in reinforcement learning on diffusion models. The proposed CAST method decomposes synthetic prompts generated from Causal Scene Graphs into independently verifiable atoms, scores each atom with a frozen VLM, and extracts teacher-forced attention maps to locate its evidence. The atom-level normalized advantages are then projected into a spatial advantage map that weights patch-level transition ratios in a windowed Flow-GRPO objective. Experiments on FLUX and Qwen-Image report gains on multiple benchmarks.
Critical strengths
-
The paper tackles an important limitation of scalar rewards for compositional generation. Preserving atom-level correctness signals and tying them to spatial regions is a meaningful direction for improving credit assignment in diffusion RL.
-
This paper is well-written and easy to follow.
Critical weaknesses
-
The reward-saturation argument is overstated. CAST and GRPO normalize rewards within a group, so a purely compressed but still reliably ordered reward scale does not by itself eliminate the advantage signal. The reported disagreement between PickScore and GenEval 2 supports objective mismatch, but high mean scores and low coefficients of variation alone do not establish that preference rewards are ineffective.
-
I am curious that whether Causal Scene Graph really works in image generation. In addition, I don't think the compositional image generation task itself, which is the main task in this paper, contain or present specific and unique causal relations. Can authors explain the motivation more clearly? Please see questions.
Questions for authors
CAST adopts a causal graph to help locate desired attributes. However, causal relation is just an interpretation that people describe relations between entities and it is hard to validate whether it is really useful for image understanding. In addition, the prompts used in the paper even do not formulate explicit causal relations, e.g., Pickscore is measured mainly from human preferences and its prompts typically do not contain reasonable causal graphs. I wonder whether this operation is necessary. Especially current prompts are more complex than simple compositional objects.
I respect the experiments and efforts authors have made. But at this time, it seems the contribution of this manuscript is mainly designing prompts for VLM queries and provide extra supervised signal during RL. The expression upon "causal" is very unconvincing to me. However, I'm willing to enhance my score if new insights are provided during rebuttal.