- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes Cycle Alignment (CycleA), a post-training method that uses a unified model’s own understanding branch as semantic feedback for generation. A frozen projector maps the generation branch’s one-step clean latent into the understanding feature space, and the frozen understanding branch answers VQA questions about the image from these features. The VQA loss and a feature-alignment loss are backpropagated into the generation branch, alternating with standard text-to-image steps, and no editing data is used. On BAGEL, CycleA improves ImgEdit (3.42 to 3.88) and GEdit-Bench-EN (6.52 to 7.08), while text-to-image scores stay comparable.
Critical strengths
I like the starting point of this paper. As a follow-up to RecA, it directly uses the model’s own understanding branch as a differentiable critic. The latent-space path is cheap, and text-to-image ability is largely preserved after post-training.
Critical weaknesses
- The method is not very intuitive. The paper uses no image editing data at all, so why does it improve image editing? RecA also uses only images and a reconstruction loss, but it has a clear intuition: the image input acts as a dense prompt, and dense, accurate supervision improves image generation. In RecA, the editing improvement is a by-product. In this paper, image generation does not improve while image editing does, which I find strange. I would also like to know how many questions the frozen understanding branch answers correctly when given the projected features of real latents. And what happens if the generated latent is decoded into an image and the understanding branch, or a stronger VLM, supervises it from there? The latter is clearly a more intuitive way to do post-training. Training a dedicated MLP to bridge the two feature spaces makes the method feel somewhat odd to me.
- The method stacks many modules, and I cannot tell which component clearly does the work, so the insight is limited. CycleA includes a separately pretrained and frozen per-patch projector, a one-step clean-latent estimate restricted to t ≤ 0.3, a VQA loss through the frozen understanding branch, a feature-alignment loss, a RecA-style reconstruction condition with 30 templates, and alternating text-to-image steps. In Tab. 3, L_vqa only (3.77), L_feat only (3.71) and captioning (3.71) are within 0.06 of each other, and there is no GEN-only row under GPT-4.1, so I cannot judge how much these variants gain over plain continued training. I think the authors should work out where the core improvement actually comes from.
- The paper does not explain how RecA is used. L269 only says the generation branch “follows the reconstruction formulation of RecA”, and the condition c is never defined. Judging from Fig. 2 and the 30 templates in Sec. 4.1, the generation branch seems to be conditioned on a reconstruction prompt plus the image’s own understanding features, and the generation stream directly reuses RecA’s data. If so, the ALIGN step is essentially RecA’s self-conditioned reconstruction, with the loss moved from latent velocity space into the feature and QA space of the frozen understanding branch. This change is reasonable in itself, but it makes RecA under the same setting the most important control, and that is exactly what the paper lacks. The RecA row in Tab. 1 is cited from the original paper, and settings such as the number of training steps may differ. In my experience, RecA-style post-training is fairly sensitive to the number of training steps, so the current comparison is not fair, and this is not necessarily to CycleA’s disadvantage. A matched comparison that replaces L_vqa + L_feat with RecA’s flow-matching loss in the same ALIGN step would show whether the semantic loss adds anything.
- The writing needs work. For example, the introduction spends a full paragraph (L74–87) on related methods, which duplicates the Related Work section. Sec. 3.3 splits a short training procedure into six bold run-in paragraphs, two pairs of which say the same thing (L353 and L355, L346 and L361). Overall, the writing, layout and allocation of detail are not yet at the level of a top venue, and I think the paper needs careful polishing.
- The Overall scores in Tab. 1 are not aggregated consistently. CycleA’s reported 3.88 is a sample-level score, and its category mean is 3.81, while for every other row cited in the table, Overall equals the category mean. Computed the same way, CycleA is 0.39 above BAGEL and only 0.05 above RecA. Could the authors check this and use one aggregation throughout?
Questions for authors
Please see Weaknesses.
8 comments
Response to Reviewer i4AJ’s Concerns (Part 2)
[W2a] Component roles and ablation evidence
We thank the reviewer for highlighting the need for clearer attribution. Our main contribution is to turn pretrained understanding into image-specific semantic feedback through a fixed, aligned latent interface. This design is supported by a 0.37 gain over decoded-image feedback using sample-level averaging under GPT-4.1, and category-average gains of 0.78 over shuffled QA and 0.22 over GEN-only training under Qwen-VL-Max. We summarize each component’s role and supporting evidence below.
| Component | Role | Related evidence |
|---|---|---|
| Pretrained, frozen projector | Provides a fixed semantic interface without RGB decoding or visual re-encoding. | (a) compares feedback paths. (i) measures the QA readout gap. |
| One-step clean-latent estimate with t ≤ 0.3 | Provides an estimated reconstruction for semantic feedback while limiting high-noise prediction errors. | (b) tests the noise restriction. |
| VQA through the frozen reader | Checks specific objects, attributes, and relations using existing understanding capabilities. | (c) removes VQA. (e) replaces it with captioning. (g) breaks image–QA correspondence. (h) measures its gradient signal. |
| Feature alignment | Constrains projected features toward source-image understanding features. | (d) removes this constraint. (h) measures its gradient signal. |
| RecA reconstruction conditions and 30 templates | Define semantic-preserving reconstruction without editing pairs. | Reused from RecA and not separately ablated. |
| Alternating GEN and ALIGN training | Retains standard generation training alongside ALIGN updates. | (f) tests the additional benefit of ALIGN over GEN-only training. |
Performance ablations evaluated with GPT-4.1
| ID | Variant | Editing score, category average |
|---|---|---|
| Reference | Full CycleA | 3.82 |
| (b) | Expand ALIGN noise to t_max = 1.0 | 3.57 |
| (c) | Remove VQA and retain feature alignment | 3.67 |
| (d) | Remove feature alignment and retain VQA | 3.75 |
| (e) | Replace VQA with captioning | 3.73 |
The feedback-path comparison (a) retains sample-level averaging:
| ID | Variant | Editing score, sample average |
|---|---|---|
| Reference | Projector-based CycleA | 3.88 |
| (a) | Replace projector feedback with decoding and re-encoding | 3.51 |
In (a), decoding and re-encoding also increases iteration time from 26.5 s to 30.4 s.
Training controls evaluated with Qwen-VL-Max
All post-trained variants use the same 2,000-step budget.
| ID | Variant | Editing score, category average |
|---|---|---|
| Reference | BAGEL | 3.87 |
| (f) | GEN-only continued training | 3.96 |
| (g) | Shuffle image–QA correspondence | 3.40 |
| Reference | Full CycleA | 4.18 |
CycleA exceeds GEN-only by 0.22, while breaking image–QA correspondence reduces its score by 0.78. Gains are computed before rounding. These controls support a benefit from image-specific semantic feedback beyond continued training.
Additional diagnostics and repeated runs
| ID | Experiment | Results | Interpretation |
|---|---|---|---|
| (h) | Gradient diagnostic on eight images at two timesteps | Median gradient norms are 6.9 for VQA and 0.09 for feature alignment. | VQA supplies the larger gradient signal within ALIGN on the tested inputs. |
| (i) | QA answer-token accuracy on 200 samples | Before → after: real images 51.3% → 51.3%, decoded reconstructions 50.9% → 51.7%, projected predicted latents 44.0% → 44.4%. | Quantifies the QA readout gap between projected predicted latents and the decoded-image and real-image references. |
| (j) | Three independent training seeds | Using sample-level averaging, BAGEL+CycleA achieves 3.85 ± 0.03, compared with 3.75 ± 0.04 for BAGEL+RecA. | Supports the repeatability of the full-method comparison. |
Response to Reviewer i4AJ’s Concerns (Part 3)
[W3] RecA conditioning and matched comparison
We thank the reviewer for identifying this ambiguity.
RecA reuse
In ALIGN, c combines source-image understanding features with a semantic-preserving reconstruction prompt reused from RecA. The VQA question is supplied separately to the frozen reader. GEN reuses RecA’s image–caption data and standard flow-matching objective. CycleA retains RecA’s reconstruction conditioning but changes how the generated content is supervised.
Matched comparison
We implemented the requested control by replacing only the VQA and feature-alignment losses in ALIGN with RecA’s flow-matching loss. The data streams, GEN/ALIGN schedule, timesteps, trainable parameters, inference settings, and evaluator remain identical. Both variants use 2,000 updates. Results across three independent training seeds are shown below.
| ALIGN objective | Editing performance, sample average, mean ± std |
|---|---|
| RecA flow matching | 3.75 ± 0.04 |
| CycleA VQA + feature alignment | 3.85 ± 0.03 |
The 0.10 mean gain with sample-level averaging supports the additional value of semantic feedback under the same reconstruction conditions. We have added this control and clarified the conditioning in the revised paper.
[W4] Writing and organization
We thank the reviewer for these suggestions and hope the revisions below address these concerns and make the paper easier to follow.
- Introduction. We shortened the discussion of prior methods and retained the detailed comparisons in Related Work.
- Sec. 3.3, training schedule. We merged the repeated GEN/ALIGN descriptions and now state the objectives and strict alternation once.
- Sec. 3.3, gradient flow and freezing. We consolidated the repeated statements and clarified that frozen parameters still allow gradients to pass through to the generator.
- Allocation of detail. We brought the essential timestep, gradient-detachment, and freezing details into the main text. Appendix A.2 retains the supporting implementation details.
- Notation and layout. We unified the notation across Figure 2, equations, and text, reduced unnecessary bold run-in headings, and polished the language throughout.
[W5] Consistent Overall aggregation
We thank the reviewer for identifying this inconsistency. We have revised Table 1 by averaging the nine category scores with equal weights for every method.
| Method | Category-average Overall |
|---|---|
| BAGEL | 3.42 |
| BAGEL + RecA | 3.76 |
| CycleA | 3.82 |
We have specified equal-weight category averaging in the evaluation section and table caption, and revised the comparative claims accordingly.
Response to Reviewer i4AJ’s Concerns (Part 1)
We thank the reviewer for the constructive comments. We clarify the reconstruction-based motivation and use the new QA and gradient measurements to explain the proposed feedback mechanism.
Weaknesses
[W1a] Why editing can improve without editing pairs
ALIGN and image editing both take a source image and a text instruction as conditions. BAGEL already supports editing. CycleA uses reconstruction QA and feature alignment to train the generation branch to better preserve objects, attributes, and relations from the source image. This can reduce semantic errors in its existing editing process without paired editing data. Text-to-image generation has no source image to preserve, so its benchmark scores need not improve in parallel.
Importantly, on GEdit-Bench-EN, CycleA raises semantic consistency from 7.36 to 8.03, achieving the highest score among all compared methods in Table 10 of Appendix A.1. This substantial improvement supports the effectiveness of our semantic guidance for editing.
[W1b] QA evaluation of the latent-to-understanding interface
We evaluated the QA answer-token accuracy on 200 samples before and after post-training, including direct real-image input as a reference. Both reconstruction routes show small numerical increases. This comparison quantifies the answer-token accuracy gap between projected features and decoded reconstructions.
[W1c] Projector rationale and comparison with decoded-image feedback
We thank the reviewer for this suggestion. We tested decoded-image feedback using the same frozen understanding branch and otherwise identical training, inference, and evaluation settings. Decoding and re-encoding takes longer and yields lower editing performance.
The additional decoding and visual encoding increase computation and lengthen the gradient path, which may attenuate the training signal. A stronger external VLM supervising decoded images would still require these stages, so stronger understanding alone would not remove this overhead or shorten the feedback path. We have added the ablation to the main paper.