- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper freezes Z-Image-Turbo and trains a S3-DiT corrector to improve few step text-to-image generation. The corrector adds a residual to the backbone's velocity at selected steps. Its inputs are the current latent and previous step's cached velocity, so it can run alongside the backbone.
Critical strengths
- Simple and deployable. The backbone stays untouched, the sampling schedule is unchanged, and overhead is small.
- The state-target pairing ablation is informative. Corrected rollout training gives +17.6, Base-rollout gives -28.
- Clear math. The eq6 split into reference velocity correction and trajectory recovery is clean, and easy to follow.
- The step timing study (Fig 8) is useful and informative.
Critical weaknesses
-
How the 574 held out target domain prompts are produced is unclear. Please report i) how eval prompts were constructed, ii) similarity to training set, and how do you ensure out of distribution testing, iii) Fraction of evaluation prompts whose subjects/relation types appear in training as well, iv) results on split that holds out subjects and relation types completely.
-
The paper motivates the method with failures in spatial relations, counting, and multi-subject interactions (Abstract, Sec. 1), and the qualitative examples emphasize these. On T2I-CompBench++, however, the gains are concentrated in attribute binding (color, shape, texture), while 2D/3D spatial, numeracy, and non-spatial are essentially unchanged or slightly worse. 2D spatial is +0.001, 3D spatial is -0.005 and numeracy is +0.001. So these are mostly flat or negative. Can the authors break down target-domain NetWin by requirement type, to show which failure modes the corrector actually fixes?
-
The headline beats zero, but most ablation gaps are within noise: 17.6 vs 14.1 (current velocity), 14.5 ({4,5}), and 13.9 ({4})
-
D-OPSD is designed for exactly this setting, so it is surprising to see a -12.37 which suggests it does worse than doing nothing. Are the official code and hyper parameters used for this? If yes, can the authors explain why it is much worse than doing nothing ?
-
Also, DiffCon is implemented on all 8 steps, inspite of the authors finding later steps can be catastrophic wrt correction. How does diffcon do if it is also applied at the same steps as proposed method ?
-
The central motivation for keeping the generator frozen, that adapting a step-distilled generator degrades image quality under its original schedule (Sec. 1, Sec. 2), is not measured. Please report image-quality metrics (e.g., FID, aesthetic score, ImageReward) for all methods in Table 1, so that the claimed advantage over LoRA-based adaptation is supported directly.
-
Fig. 1 argues from the 50-step Z-Image vs. Turbo velocity gap, but the method never uses Z-Image. Using 50-step Z-Image outputs from the same ε as targets would directly test that motivation. Fig. 1c shows Z-Image at +19.5 vs. Turbo, so this is a natural ceiling.
-
Only one backbone is evaluated. The method should be verified on multiple backbones such as flux, Owen etc to confirm that the approach generalizes
Questions for authors
see weaknesses
8 comments
W2:
We sincerely thank the reviewer for highlighting this important concern. To identify which types of instruction-following errors our method actually improves, we conducted an additional requirement-level analysis of the 574 target-domain evaluation prompts.
Specifically, we reanalyzed the existing atomic-level requirement annotations and their evaluation outcomes, without regenerating images or rerunning the judge. For each requirement category within each prompt, we aggregated the corresponding atomic-level judgments into a single GSB outcome, following the original evaluation protocol that prioritizes core requirements over detailed requirements (core-then-detail). We then calculated category-specific NetWin scores and 95% confidence intervals using prompt-level bootstrap resampling.
Breakdown of Target-Domain NetWin by Requirement Type
| Requirement Type | Prompts | Win / Tie / Loss | NetWin (pp) | 95% CI (pp) |
|---|---|---|---|---|
| Action / Pose / Orientation | 571 | 160 / 315 / 96 | +11.21 | [+5.63, +16.43] |
| Position / Spatial Relations | 574 | 67 / 477 / 30 | +6.45 | [+3.14, +9.76] |
| Character / Identity | 314 | 23 / 283 / 8 | +4.78 | [+1.30, +8.23] |
| Counting / Numeracy | 200 | 12 / 182 / 6 | +3.00 | [−1.01, +7.22] |
Under the original evaluation protocol, action/pose/orientation and position/spatial relations exhibit the largest positive NetWin point estimates, with both confidence intervals excluding zero. Character-related requirements also show a positive improvement, while the gain in counting remains modest and statistically uncertain.
These findings clarify that our method does not uniformly improve all semantic attributes. Instead, its target-domain gains are more pronounced for action-related and spatial-relation requirements, consistent with our motivation to address complex structural instruction-following errors.
We also acknowledge that the limited improvements in spatial reasoning and numeracy on T2I-CompBench++ indicate that these benefits do not necessarily generalize uniformly across benchmarks. We will clarify the scope of these improvements and incorporate the requirement-level analysis into the revised paper.
W3:
We sincerely thank the reviewer for raising this important concern regarding the statistical reliability of our ablation results. To assess the impact of generation randomness, we repeated the evaluation using three different random seeds on the same 574 evaluation prompts and report the mean and standard deviation of GSB NetWin.
| Configuration | Mean ± SD (pp) |
|---|---|
| Ours ({2,3,4}) | 17.60 ± 0.45 |
| Current velocity | 14.10 ± 0.51 |
| Steps {4,5} | 14.50 ± 0.43 |
| Step {4} | 13.90 ± 0.60 |
The results show that our full method maintains a higher mean NetWin than all ablated configurations, with improvements of 3.10–3.70 percentage points. These differences are substantially larger than the observed standard deviations (0.43–0.60 pp), providing additional evidence that the advantages of our selected configuration are consistent across different generation seeds, rather than being attributable solely to generation randomness.
W4:
We thank the reviewer for raising this important concern. To clarify the negative D-OPSD result, we provide details of our implementation, additional checkpoint evaluations, and a possible explanation supported by the original D-OPSD paper and related studies.
Implementation and checkpoint evaluation. We followed the authors' publicly released Z-Image-Turbo training script, using a learning rate of (1\times10^{-4}) and 2,000 optimizer steps, consistent with the released script. We additionally evaluated the checkpoints at steps 1,000 and 2,000. Both checkpoints yielded negative NetWin scores on our target-domain evaluation, with the final checkpoint achieving −12.37 percentage points. This indicates that the negative result is not solely attributable to the selection of the final checkpoint.
Possible explanation. Although D-OPSD is designed for adapting step-distilled models, its primary objective is to learn new concepts, styles, and domains while preserving few-step generation capability, rather than explicitly optimizing complex compositional instruction following. Its supervision aligns the text-conditioned student's velocity predictions with those of a multimodally conditioned teacher. Thus, its effectiveness depends on whether the teacher provides sufficiently informative supervision for the target task.
Importantly, the original D-OPSD paper (Jiang et al., NeurIPS 2026, Sec. 4, Fig. 7) explicitly identifies teacher capability as a critical limitation, showing that training may fail when the multimodally conditioned teacher cannot provide effective supervision. In contrast, our objective is to improve the model's own instruction-following capability, which may require supervisory signals beyond what the teacher itself can reliably provide.
Furthermore, its Table 2 reports that, under full fine-tuning for domain adaptation, D-OPSD improves FID and aesthetic quality on Z-Image-Turbo, while GenEval decreases from 0.7543 to 0.7170 and DPG decreases from 84.7645 to 84.1116. The authors discuss these changes as a trade-off associated with domain adaptation.
Related studies, including ClassDiffusion (Huang et al., ICLR 2025) and Preserve and Personalize (Kim et al., ICLR 2026), further demonstrate that fine-tuning for concept or subject fidelity can compromise compositional generation and prompt adherence. These findings suggest that improvements in adaptation-related objectives do not necessarily translate into better complex instruction following. Therefore, performance degradation on our task is consistent with the limitations and trade-offs documented in prior work.
W5:
We thank the reviewer for this insightful suggestion. To ensure a fairer comparison, we conducted an additional experiment restricting DiffCon's intervention steps to {2, 3, 4}, matching those of our proposed method.
| Method | Intervention Steps | GSB NetWin (pp) |
|---|---|---|
| DiffCon | All 8 sampling steps | +1.74 |
| DiffCon | {2, 3, 4} | +4.70 |
| Ours | {2, 3, 4} | +17.25 |
Restricting DiffCon to steps {2, 3, 4} increases its NetWin from +1.74 to +4.70 percentage points. This improvement suggests that early-step intervention also benefits DiffCon, supporting our motivation for restricting the correction steps.
Nevertheless, DiffCon's performance remains substantially below that of our method (+4.70 vs. +17.25 percentage points), even under the same intervention schedule. These results indicate that the performance advantage of our method cannot be explained solely by the selection of correction steps, suggesting additional benefits from our correction framework.
W1:
We thank the reviewer for the valuable suggestions. We clarify the prompt construction pipeline and the train–evaluation separation protocol as follows.
(i) Evaluation prompt construction.
Our prompt-construction pipeline shares the design principles of ConceptMix (Wu et al., NeurIPS 2024): sampling visual concepts, organizing their bindings into structured representations, generating natural-language prompts with an LLM, and validating the prompts for conflicts. Our implementation targets complex illustration scenes and includes explicit character, action, interaction, and scene specifications, together with consistency checking and atomic-requirement extraction. All compared methods are evaluated using the same resulting prompts and standardized formatting, providing a consistent basis for comparison.
Our prompts were generated through a four-stage, constraint-based pipeline:
(ii–iii) Train–evaluation similarity and OOD guarantees.
Importantly, the training and evaluation sets were constructed using a type-level disjoint sampling protocol established before prompt generation. We first partitioned the predefined subject categories, character identities and aliases, and action/interaction relation types into non-overlapping training and evaluation pools.
All participating subjects—including primary characters, secondary characters, generic subjects, and background participants—were restricted to their respective pools. The same constraints also applied to auxiliary-character sampling and fallback action selection. The validation set used only training-side types.
Consequently, the evaluation set was designed to contain no overlap in predefined subject identities/types or action/interaction relation types with the training set, while retaining the same overall illustration domain and prompt-generation framework.
(iv) Results on fully held-out subjects and relations.
The original 574-prompt evaluation set already follows this joint subject-and-relation holdout protocol. Therefore, the reported target-domain results directly evaluate generalization to unseen subject and relation types, rather than requiring an additional split. Our Corrector achieves a NetWin of +17.25 percentage points over the frozen Z-Image-Turbo baseline on this set.
Due to data confidentiality restrictions, we cannot publicly release the underlying prompt collection. We plan to release the prompt-construction pipeline code, subject to the applicable disclosure restrictions, to facilitate reproducibility.