- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates how multimodal agent reasoning can improve instruction following, attribute binding, and compositional relation errors in text-to-image (T2I) generation. The authors propose a training-free framework, Multimodal Agent Debate (MAD), in which a proponent and an opponent debate the current image against a set of dynamic verification criteria. A Moderator then determines whether the prompt is satisfied and derives verifiable diagnostic conditions. A Regulator, drawing on these diagnostics and the accumulated history, decides between executing an image edit and adding constraints to trigger re-debate, thereby linking language-level corrections to the downstream image editor. The authors report that the framework improves the Overall scores of multiple generation systems on GenEval, T2I-CompBench, and TIIF-Bench.
Critical strengths
1.The MAD framework cleanly separates "diagnosing what is wrong" from "making edits that are executable," which carries clear engineering value. Rather than feeding raw critique text directly to the editor, the framework introduces a control branch that chooses between executing an edit and adding constraints to trigger re-debate. This design explicitly acknowledges, at the system level, that identifying a problem and effectively fixing it are not the same task. It also provides an observable interface for analyzing ineffective edits and repeated operations.
2.The experiments are thorough and cover multiple generation systems. The evaluation (Table 1) reports paired Base/MAD results for Kontext, SDXL, ReasonGen-R1, GoT, MILR, and TwiG, and CLIP-FID decreases across all three reported datasets. This provides preliminary evidence that the method offers a degree of transferability across different generation systems.
Critical weaknesses
1.The novelty of this work is somewhat limited. The authors extend traditional text-based debate into multimodal agent debate to enhance the semantic fidelity of generated images, but this approach leans more toward incremental methodological improvement than an original theoretical breakthrough. Moreover, the idea of leveraging multimodal agents to strengthen image generation and editing has already appeared in existing works such as T2I-Copilot[1], GenArtist[2], and Crea[3]. The authors therefore need to more clearly articulate the essential distinction between their contribution and these existing methods.
2.The final-image selection rule shown in part 5 of Figure 3 — , i.e., selecting the best frame from history — contradicts the rule stated in Eq. (13) of Section 3.4, which terminates early by returning upon the first satisfaction and otherwise returns once the budget is exhausted, without additional evaluation. The former requires running all rounds and then picking the optimal frame from history, whereas the latter requires terminating immediately and returning the current frame. These two strategies cannot both hold. Please clarify which implementation is actually adopted and reconcile the two statements.
[1]. T2i-copilot: A training-free multi-agent text-to-image system for enhanced prompt interpretation and interactive generation[C]//2025 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2025
[2]. Genartist: Multimodal llm as an agent for unified image generation and editing[J]. Advances in Neural Information Processing Systems, 2024.
[3].A collaborative multi-agent framework for creative image editing and generation[J]. Advances in Neural Information Processing Systems, 2026
Questions for authors
1.The dynamic criteria (the criteria roadmap) in MAD may introduce requirements beyond the original prompt, yet the authors do not clearly specify which newly added criteria constitute necessary semantic completion (e.g., common-sense details about objects or scenes) and which constitute unauthorized goal expansion (e.g., additional attributes or preferences not requested by the user). We recommend that the authors explicitly distinguish three categories of constraints — original hard constraints, necessary object/scene common sense, and optional visual-quality preferences — and further clarify the priority rules for handling conflicts between newly added criteria and the original prompt.
2.The authors introduce adversarial proponent–opponent debate in MAD, but the ablation study does not adequately examine the independent contribution of the adversarial design itself. The current comparison only contrasts two debaters against a single critic (Single Critic), which cannot isolate the respective effects of "multi-agent" versus "adversarial interaction." We recommend adding control experiments such as two cooperative critics and two independent checkers with aggregated results, so as to independently assess the contribution of the adversarial interaction itself.
2 comments
Question 2. Independent contribution of adversarial interaction versus multiple agents.
Thank you for your valuable suggestions. We have added the two suggested controls, and they show that the gain comes from adversarial interaction rather than from the number of agents. Both controls are run on T2I-CompBench and use two agents without opposing roles. All other components are retained. Two Cooperative Critics reaches 45.69% Overall, and Two Independent Checkers reaches 45.37% (Table R3). Neither clearly exceeds the single critic at 45.50%. Full MAD reaches 46.75%. Making the two agents oppose each other thus adds 1.06 to 1.38 points over the two-agent controls.
The advantage is consistent across categories. Full MAD outperforms Two Independent Checkers in all six categories. It also outperforms Two Cooperative Critics in five of the six categories. The largest gap is on Color (+1.63 and +2.51 points, respectively). We will add both controls to Table 2 of the revised manuscript.
Table R3. Controls for agent number and adversarial interaction on T2I-CompBench.
| Method | Color | Shape | Texture | Spatial | Non-spatial | Complex | Overall ↑ |
|---|---|---|---|---|---|---|---|
| MAD w/ Single-Critic Reasoning | 72.58% | 51.26% | 62.87% | 29.85% | 25.63% | 30.81% | 45.50% |
| Two Cooperative Critics | 73.65% | 49.68% | 63.80% | 30.20% | 25.56% | 31.23% | 45.69% |
| Two Independent Checkers | 74.53% | 50.15% | 63.52% | 30.04% | 24.43% | 29.54% | 45.37% |
| MAD | 76.16% | 51.84% | 64.55% | 30.76% | 26.08% | 31.09% | 46.75% |
Weakness 1. Novelty and distinctions from existing agentic generation frameworks.
Thanks for your comment. We would like to clarify that MAD differs from existing frameworks in targeting editing needs that are dynamic, relative and incremental. Each edit changes the image. The next need is thus relative to the current result rather than to the prompt alone. T2I-Copilot, GenArtist and CREA coordinate agents cooperatively toward overall semantic fidelity. Once this goal is met, the agents tend to agree and stop. For example, a prompt asks for a cat but the initial image shows a dog. After the first edit turns the dog into a cat, cooperative agents accept the image. The cat may still lack whiskers. This need appears only after the first edit. In MAD, the opponent must challenge the current image. It raises the missing whiskers as the next increment. MAD then updates its criteria to include them. Fig. 6 shows a similar case. In it, single-agent CoT accepts an image with missing toothbrush bristles. MAD identifies and corrects this omission.
Our results support this distinction. Under the same settings with Qwen-Image-Edit, MAD achieves 85.55% on GenEval. T2I-Copilot and CREA reach 68.50% and 52.99% (Table R1). On T2I-CompBench, Two Cooperative Critics reaches 45.69% Overall, against 46.75% for full MAD (Table R3). Fixing the criteria lowers T2I-CompBench Overall from 0.4675 to 0.4624 (Table 2 of the main paper).
Table R1. GenEval results for external frameworks and MAD.
Weakness 2. Inconsistent final-image selection rules in Fig. 3 and Eq. (13).
Thank you for carefully checking Fig. 3 against Eq. (13) and pointing out this inconsistency. We have corrected Fig. 3 to follow Eq. (13), which is the rule our implementation adopts. The argmax rule in part 5 of Fig. 3 was an error in the figure. MAD returns the current image as soon as the Moderator judges that it satisfies the prompt. If the budget is exhausted, MAD returns the final image without further evaluation. No selection over historical images is performed. Appendix B states the same rule in its discussion of the maximum debate budget.
Question 1. Scope and priority of dynamically added criteria.
Thank you for your valuable suggestions. We have classified the added criteria into the three suggested categories. Most are original requirements or necessary semantic completion, and the original prompt always takes priority. We used Qwen and Mistral as annotators (Table R2). Both annotators identify necessary object or scene common sense as the largest category. Original hard constraints and necessary common sense together account for 70.94% to 80.89% of the criteria.
Optional preferences cannot override the original prompt. The Moderator detects a violation only when the image fails the original prompt requirements (Appendix C). An added preference therefore does not trigger an edit by itself. The proponent also defends regions that already satisfy the prompt. We have defined the three categories and this priority rule explicitly in the revised manuscript.
Table R2. Distribution of analyzed criteria by annotator and dataset.