- Rating
- 3(+1)
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies spatial text-to-image post-training through two components: SpatialCritic, a tool-augmented reward agent trained with outcome supervision, and a capability-graph curriculum incorporating mastery assessment, review, and remediation. Experiments evaluate preference judgment, candidate selection, and downstream reinforcement learning on SD3.5-Medium and BAGEL.
The approach contains identifiable methodological additions and reports improvements. However, the experiments establish the benefits of the complete system more clearly than the necessity or cost-effectiveness of its agentic reward component.
Critical strengths
-
The paper addresses a relevant problem: inaccurate spatial feedback and poorly organized training can limit generation quality beyond the training distribution.
-
The agent ablations distinguish tool-free judgment, fixed tool execution, and dynamic planning, both before and after RL. These provide direct evidence that adaptive evidence acquisition improves accuracy on SpaRW-Eval.
-
The curriculum ablation separately examines prompt data, graph-guided progression, and review/remediation. Evaluation on two generation backbones also provides useful evidence of applicability.
Critical weaknesses
-
The substantive advance over closely related reward models needs sharper delineation. SpatialReward already combines prompt decomposition, expert perception, and grounded VLM reasoning. The main addition here is learning adaptive evidence acquisition and integration. SpatialScore already uses spatially perturbed preference pairs and a specialized reward for online RL, so counterfactual preference construction is not itself a distinct contribution. The fixed-routine ablation supports dynamic planning, but does not substitute for a matched comparison with SpatialReward.
-
The downstream contribution of the new reward is not adequately isolated from the curriculum. Table 3 includes SpatialReward and SpatialScore on SD3.5-Medium, but does not combine them with the same curriculum used by the proposed system. Consequently, the results do not establish whether SpatialCritic is necessary for the final gains, or whether an existing spatial reward with the same prompt pool and scheduler would perform similarly. Differences in reward normalization or rank conversion should also be controlled.
-
The additional complexity is not accompanied by sufficient cost–benefit evidence. Without the curriculum, SpatialCritic achieves 81.9 versus 80.8 for SpatialScore on SD3.5-Medium. The complete system reaches 83.9, compared with 82.3 for DiffusionNFT with GenEval-2. These are positive numerical gains, but their practical value is difficult to assess against data construction, agent RL, tool inference, and curriculum assessment costs. Parameter counts, response-length reductions, and example-level latency do not establish end-to-end efficiency. The paper therefore leaves the return on this additional investment unresolved.
-
Some comparisons and uncertainty estimates are missing. SpatialReward is absent from the main preference-accuracy table; both spatial reward baselines are absent from the candidate-selection table and BAGEL results. Independent training runs or uncertainty estimates are not reported, limiting interpretation of smaller downstream differences. SpaRW-Eval also heavily weights attribute and existence examples, so its overall accuracy alone does not establish broad geometric verification performance.
Questions for authors
-
How do SpatialReward and SpatialScore perform with the identical curriculum, prompt pool, optimizer, generation budget, and reward transformation?
-
Does agent–harness alignment improve downstream generation relative to the unaligned SpatialCritic, beyond improving preference accuracy?
-
What are the total reward-construction costs and average online evaluation costs, including tool calls? How do methods compare under equal GPU-hour or wall-clock budgets?
-
Can you provide repeated-run results and an independent human evaluation of the key downstream comparisons?
8 comments
Response to Q2
[Q2] Does agent–harness alignment improve downstream generation relative to the unaligned SpatialCritic, beyond improving preference accuracy?
[A2] We train SD3.5-Medium under the same curriculum with SpatialCritic before and after AHA, as reported in App. A.3 and listed in Tab. R1. In the reward evaluation, AHA raises SpaRW-Eval accuracy from 92.9% to 95.1% in Tab. 1 and shortens responses by 38.3% in Fig. S2.
Table R1. Downstream effect of agent–harness alignment under the identical curriculum on SD3.5-Medium, corresponding to Tab. S3 in the revised manuscript.
| Method | Reward | BR | AR | RR | 2D | 3D | Basic | Spatial | IR | PS | HPS | Avg |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| w/ Flow-GRPO with CL | SpatialCritic w/o AHA | 84.1 | 82.9 | 73.4 | 88.0 | 82.7 | 93.5 | 69.1 | 0.888 | 0.850 | 0.305 | 82.0 |
| w/ Flow-GRPO with CL | SpatialCritic w/ AHA | 86.2 | 83.9 | 74.1 | 93.3 | 85.3 | 95.0 | 69.5 | 0.908 | 0.857 | 0.305 | 83.9 |
AHA raises the average from 82.0 to 83.9 and improves all three benchmarks, raising TIIF-Bench RR from 73.4 to 74.1, UniGenBench++ 2D from 88.0 to 93.3, and SpatialGenEval Spatial from 69.1 to 69.5. AHA therefore improves both preference accuracy and downstream generation.
We thank the reviewer for this comment.
References
[1] SpatialReward: Verifiable Spatial Reward Modeling for Fine-Grained Spatial Consistency in Text-to-Image Generation. CVPR 2026.
[2] Enhancing Spatial Understanding in Image Generation via Reward Modeling. CVPR 2026.
[3] CREPE: Can Vision-Language Foundation Models Reason Compositionally? CVPR 2023.
[4] SpatialReward: Official Implementation. Code repository, 2026.
Response to W2 & Q1
[W2] The downstream contribution of the new reward is not adequately isolated from the curriculum. Table 3 includes SpatialReward and SpatialScore on SD3.5-Medium, but does not combine them with the same curriculum used by the proposed system. Consequently, the results do not establish whether SpatialCritic is necessary for the final gains, or whether an existing spatial reward with the same prompt pool and scheduler would perform similarly. Differences in reward normalization or rank conversion should also be controlled.
[Q1] How do SpatialReward and SpatialScore perform with the identical curriculum, prompt pool, optimizer, generation budget, and reward transformation?
Response. We thank the reviewer for this insightful suggestion. We answer [W2] and [Q1] together with a matched-curriculum comparison in [A1].
Revision. In the App., we added the matched-curriculum comparison with SpatialReward and SpatialScore in App. A.3 and Tab. S3.
[Q1] How do SpatialReward and SpatialScore perform with the identical curriculum, prompt pool, optimizer, generation budget, and reward transformation?
[A1] As discussed in our response to W1, SpatialScore fits preference scores to its training pairs and SpatialReward follows category-specific routines, and thus neither generalizes beyond the spatial relations and categories it was built for.
We train SD3.5-Medium with SpatialReward and SpatialScore under the same Full CL scheduler, prompt pool , mastery probe, RL method Flow-GRPO, and rollout budget used for SpatialCritic. The two new rows with CL are reported in App. A.3 and listed in Tab. R2.
Table R2. Spatial rewards without and with the identical curriculum on SD3.5-Medium, corresponding to Tabs. 3 and S3 in the revised manuscript.
| Method | Reward | BR | AR | RR | 2D | 3D | Basic | Spatial | IR | PS | HPS | Avg |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| w/ Flow-GRPO | SpatialReward | 81.3 | 80.1 | 69.6 | 76.2 | 77.3 | 92.6 | 65.0 | 0.451 | 0.823 | 0.259 | 77.4 |
| w/ Flow-GRPO | SpatialScore | 83.4 | 80.9 | 69.4 | 92.1 | 78.7 | 93.7 | 67.3 | 0.885 | 0.857 | 0.306 | 80.8 |
| w/ Flow-GRPO | SpatialCritic | 83.3 | 80.3 | 69.8 | 93.3 | 85.3 | 94.4 | 67.0 | 0.857 | 0.855 | 0.304 | 81.9 |
| w/ Flow-GRPO with CL | SpatialReward | 82.7 | 78.6 | 68.8 | 88.2 | 81.3 | 93.2 | 66.1 | 0.862 | 0.854 | 0.303 | 79.8 |
| w/ Flow-GRPO with CL | SpatialScore | 83.2 | 75.8 | 71.0 | 81.4 | 68.0 | 92.6 | 65.8 | 0.436 | 0.820 | 0.243 | 76.8 |
| w/ Flow-GRPO with CL | SpatialCritic | 86.2 | 83.9 | 74.1 | 93.3 | 85.3 | 95.0 | 69.5 | 0.908 | 0.857 | 0.305 | 83.9 |
As shown in Tab. R2, SpatialCritic achieves 83.9 under the identical curriculum, outperforming SpatialReward at 79.8 and SpatialScore at 76.8. We attribute the gap to the limitations discussed in our response to W1. SpatialScore does not generalize to the curriculum prompts and drops from 80.8 to 76.8, while the category-specific routines of SpatialReward limit its gain to 77.4 to 79.8. The benefit of CL therefore depends on how well the reward model generalizes, and CL helps most when paired with a reward that generalizes well, such as SpatialCritic, which improves from 81.9 to 83.9.
We thank the reviewer for requesting this controlled ablation.
Response to W1
Response. We thank the reviewer for this constructive comment on our contributions. We answer [W1-1] by clarifying the methodological differences, [W1-2] with matched comparisons, and [Q2] with a downstream ablation of agent–harness alignment.
Revision. In the main manuscript, we expanded Sec. 2 to clarify the differences from SpatialReward and SpatialScore. In the App., we added the downstream AHA ablation in App. A.3 and Tab. S3.
[A1-1] In the revised Sec. 2, we clarify how SpatialCritic differs from SpatialReward and SpatialScore. SpatialCritic decides which evidence to acquire and how to integrate it, and agent–harness alignment trains this decision process with verifiable outcome rewards. We compare the methods below.
(1) Comparison with SpatialReward. SpatialReward [1] grounds decomposed spatial constraints with expert detectors and reasons over the resulting observations. Its verification procedure is determined prior to observation, following a pre-defined routine per task category [4]. SpatialReward uses category-specific verification routines, whereas our agent selects and composes tools according to the claims and uncertainties in each input. Under matched RL post-training without CL, SpatialCritic reaches an average of 81.9 versus 77.4 for SpatialReward in Tab. 3. (2) Comparison with SpatialScore. SpatialScore [2] trains a reward model on constructed spatial preference pairs, but it is essentially a regression-based reward model. It therefore inherits the main limitation of such models, as a learned score fits the training distribution and generalizes poorly to data outside it. SpatialScore learns preference scores from spatial pairs, whereas we use such pairs [2, 3] as a verifiable environment for learning tool selection and evidence integration. On the held-out 3D-Pose category, SpatialScore obtains only 61.7% versus 95.6% for SpatialCritic in Tab. 1.
[A1-2] We add a matched comparison with SpatialReward in our response to W2 & Q1. SpatialReward, SpatialScore, and SpatialCritic are trained on SD3.5-Medium under the same curriculum, prompt pool, RL method, and rollout budget. SpatialCritic reaches an average of 83.9, compared with 79.8 for SpatialReward and 76.8 for SpatialScore, as shown in Tab. R2.