- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Seenk, a framework for detecting and correcting inconsistencies between generated images and their text descriptions. The method fine-tunes Qwen-Image-Edit-2511 to generate mask-annotated images as intermediate visual thoughts, which are then used to guide a separately fine-tuned image editor. The visual reasoner is trained through SFT followed by spatially weighted DPO, using automatically constructed training and preference datasets. Experiments show substantial improvements in mismatch localization on the authors' benchmark and competitive image editing performance.
Critical strengths
The paper is generally well written, and the overall pipeline is easy to follow. The automated data construction process is practical and provides a reasonable way to obtain supervision for mismatch localization. The improvement in localization accuracy after SFT is substantial, suggesting that diffusion-based editing models can be adapted effectively to this task.
Critical weaknesses
1. Limited novelty and insufficient discussion of closely related work.
My main concern is the novelty of the proposed framework. Several existing works have already explored very similar ideas, particularly GVCoT (2026), MURE (2025), and D-TIIL (ICLR 2024). GVCoT is especially relevant, as it already explores generating visual spatial cues as intermediate reasoning steps before image editing, using SFT followed by further optimization. MURE also incorporates visual masks into an explicit reasoning process, while D-TIIL addresses text-image inconsistency localization using diffusion models.
These works are not identical to Seenk, and I recognize that this paper focuses specifically on detecting mismatches against a target description. However, the paper does not adequately discuss these closely related approaches or establish why its formulation offers a meaningful advantage. The core framework still appears to be a fairly straightforward combination of mismatch localization, mask generation, and image editing.
The proposed DPO refinement also seems incremental. The spatial weighting strategy is reasonable, but its contribution is limited in the reported experiments: pixel IoU improves only from 0.768 to 0.775, while VQAScore increases from 0.750 to 0.752. Without comparisons to standard DPO or simpler mask refinement techniques, it is difficult to assess the benefit of this additional training stage.
2. Insufficient experiments to establish the necessity and generality of the proposed method.
The most important missing experiment, in my opinion, is a direct editing baseline trained on the same data. Since the method constructs paired inconsistent and corrected images, a natural alternative is to fine-tune Qwen-Image-Edit directly to map the inconsistent image and target description to the corrected image, without generating an intermediate mask. I do not see this comparison in the paper. It is therefore unclear whether the improvement actually comes from the proposed visual reasoning framework or simply from task-specific fine-tuning on the constructed dataset.
Relatedly, most baseline models are not fine-tuned on the same task and data. Comparing a task-specific trained model against mostly prompted general-purpose models does not sufficiently isolate the methodological contribution. A fine-tuned VLM-based localization pipeline followed by the same editor would also be an informative comparison.
The evaluation is relatively limited. The main benchmark contains only 100 curated examples, and several complex error categories, including geometry, physics, and spatial relationships, have very few or no evaluation samples. The experiments on additional reasoning steps are largely qualitative. Moreover, the method is evaluated using only Qwen-Image-Edit as its backbone, without demonstrating transfer to another editing architecture such as FLUX.2.
Another missing aspect is background preservation. The method aims to correct local inconsistencies while retaining correct content, but the paper does not directly measure changes outside the intended editing regions. Global similarity metrics such as DINO and CLIP-I are not sufficient to establish this property.
Finally, the claim of native diffusion-based visual reasoning deserves more investigation. Qwen-Image-Edit already includes a Qwen2.5-VL-based semantic encoder. Without further analysis, it is unclear to what extent the learned mismatch understanding comes from the pretrained vision-language representations rather than the diffusion generator itself. This does not invalidate the method, but it makes the paper's interpretation of the learned capability less convincing.
Overall, I find the technical pipeline reasonable, but the contribution seems largely driven by a standard synthetic data construction and fine-tuning recipe. The experimental evidence does not sufficiently establish the necessity of the proposed intermediate reasoning representation or its advantage over closely related alternatives. Given the limited novelty and missing controls, I do not think the current submission meets the acceptance bar for ICLR.
Refs:
[1] GVCoT: Generative Visual Chain-of-Thought for Image Editing (2026). https://arxiv.org/abs/2603.01893
[2] MURE: Beyond Textual CoT: Interleaved Text-Image Chains with Deep Confidence Reasoning for Image Editing (2025). https://arxiv.org/abs/2510.08157
[3] D-TIIL: Exposing Text-Image Inconsistency Using Diffusion Models (ICLR 2024). https://arxiv.org/abs/2404.18033
Questions for authors
-
How does Seenk differ fundamentally from GVCoT, MURE, and D-TIIL? In particular, what advantage does the proposed visual reasoning formulation provide beyond the existing mask-based reasoning and editing approaches?
-
What happens if Qwen-Image-Edit is directly fine-tuned on the same inconsistent/corrected image pairs, without generating intermediate visual thoughts? This comparison seems essential to establish the contribution of the proposed reasoning stage.
-
How much of the improvement comes specifically from spatially weighted DPO? Could the authors compare against standard DPO and simple mask post-processing methods? Given the small gains, are the improvements consistent across evaluation samples?
-
Can the authors provide stronger evidence of generalization, including a larger independent benchmark, quantitative background preservation metrics, and results using another image editing backbone?
-
Since Qwen-Image-Edit contains a pretrained Qwen2.5-VL-based semantic encoder, what evidence supports attributing the learned reasoning capability to the diffusion component? Is there any analysis separating the contributions of the semantic encoder and the generator?
Clarifying Core Misunderstandings About Seenk
We thank the reviewers for their time and respectfully ask the Area Chair to intervene. The reviews judge Seenk against objectives it does not pursue, leaving no meaningful basis for a rebuttal. Further discussion requires the reviewers to revisit the Introduction and reassess the work based on its stated task, motivation, and contributions. We clarify these three misunderstandings below.
[R-HYGs W1, R-VATK W1 Q1, R-W9JK W1 Q1] Misunderstanding the mismatch correction task. As shown in the table below, Seenk addresses a different problem from conventional mask localization, image editing, and localization-based image editing. The similarity of their inputs and outputs makes the key distinction easy to overlook. In those tasks, users specify what to find or change. In Seenk, the model must make these key decisions without human-specified targets. In the mismatch correction task of Seenk, the text description is the only case-specific guidance in the prompt. The diffusion model itself must reason implicitly over the image and description, identify what is inconsistent, and mark the affected region.
This distinction clarifies the comparisons raised in the reviews. DiffEdit derives a mask by contrasting denoising predictions under different prompts. Seenk learns to infer the discrepancy and generate the mask directly. D-TIIL also addresses inconsistency localization, but it obtains the result through multiple stages of alignment, mask generation, and image editing. Its focus is on constructing that procedure, whereas ours is on eliciting the judgment within the diffusion model. GVCoT, MURE, and InstructEdit start from an explicit edit instruction that specifies the intended change. GVCoT is built on a unified multimodal model, MURE includes textual reasoning, and InstructEdit uses a language processor.
Misunderstanding the motivation of Seenk. Large-scale generative pretraining gives LLMs the understanding and generation capabilities on which their reasoning builds. Diffusion models also undergo large-scale generative pretraining, yet they are still viewed primarily as visual generators, and their capacity for higher-order understanding and reasoning remains underexplored. Vision Banana and SenseNova-Vision show that fine-tuning visual generators with suitable data can elicit capabilities such as segmentation and depth estimation. This motivates our question: Can a diffusion model also learn to perform more demanding visual reasoning through its own generation process?
Misunderstanding the contribution of Seenk. We propose a novel visual reasoning paradigm that equips the diffusion model itself to perform implicit visual reasoning and express its judgments directly as visual outputs. Depending on the task, these outputs can take the form of segmentation masks, super-resolved images, depth maps, optical flow maps, or surface normal maps, all of which can guide subsequent processing. Compared with reasoning expressed in text by a VLM, direct visual generation can convey more precise region boundaries, finer visual details, and pixel-level information about depth, motion, and surface orientation. We demonstrate the value of this paradigm on mismatch correction, where the generated mask provides precise spatial guidance for the downstream editor.