- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces R3, a framework that decomposes text-to-image evaluation into target structuring, independent visual observation, and target–evidence matching. Entity-bound rubrics, frozen observations, and a separate spatial-matching channel produce region-level and image-level rewards. The authors also introduce GranuBench and R3Traj-100K and distill the pipeline into Open R3 using stage-specific LoRA adapters.
Critical strengths
[1] The framework is well motivated, with explicit information boundaries and deterministic reward aggregation. Entity-level feedback is useful for traceable evaluation and targeted correction.
[2] Component ablations, external benchmarks, and a blinded human study provide meaningful evidence of practical usefulness.
Critical weaknesses
[1] The writing is occasionally verbose and convoluted, while key experimental details are insufficiently clear, making the evaluation protocol difficult to follow and reproduce.
Questions for authors
[1] The authors are encouraged to evaluate R3 for reward-guided T2I post-training and compare it with RubricRL and SpatialReward on DPG-Bench and GenEval, preferably using shared backbones such as SD3.5, FLUX.1-dev, or Qwen-Image under comparable experimental settings, with matched post-training algorithms, training data, and compute budgets.
[2] A sharper comparison with SpatialReward and RubricRM would help isolate the contribution of the information-separation design.
[3] Although R3 omits SAGE when no meaningful spatial target is available and uses a soft spatial penalty, how are multiple valid layouts handled once a target box is assigned? Please provide GranuBench statistics on target-box coverage and a human audit assessing whether spatial penalties are applied to valid alternative compositions.
[4] Equations (2) and (3), together with their accompanying explanations, are repetitive and could be consolidated for conciseness.