- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes AcFlow, a trained controller to produce velocity vectors for each image token that is used to steer the diffusion at each timestep to manipulate image generation. The method is implemented using concept cross-attention with queries as image activations and keys/values and concept text embeddings followed by self-attention + feedforward operations. The controller is trained with distillation, a frozen model with the trainable controller (student) operating on the source prompt should reproduce the denoising prediction of the same frozen model operating on a target prompt (e.g., with the concept removed, added). Experiments are conducted on style and concept supression tasks.
Critical strengths
- The paper introduces strength controlling in text-driven image editing, which is interesting and needed
- The method is simple and elegant
- The paper overall is well-written and it is an interesting read
- It is nice to see the authors use the simple Euler's method for estimating the differential equation - rather than complicated solvers.
- I also liked the idea of using activation flow rather than fixed steering, since the velocity can change with the current hidden state, using a fixed direction is not ideal.
Critical weaknesses
- The paper misses a very relevant work and borrows ideas from it, without comparing to it neither citing it [R1]. The reference paper does exactly the same thing -- at a timestep t (defined according to temporal dynamic analysis) they switch the prompt from the source to the target, manipulating style, removing or adding concepts. [R1] does not even require training, and operates completely at inference time. The proposed method on the other hand requires training, and it actually trains on [R1] method. So it is unclear why we need the proposed method if R1 (or the training of the controller in the authors work - which is fully borrowed from [R1]) directly provides the ground-truth and in no training. The paper further borrows concepts from [R1] such as using VLMs to judge if a concept is present or not. Again without citing [R1].
- The method degrades original content as the strength increases (Table 2 and Figure 5 and Figure 6, and 40% failures of concept supression). This is a huge downside, because if the only novelty and advantage of the method is strength control, then this comes at a huge expense on content degradation.
- There are many works on text-driven image editing that perform editing in a completely training-free manner [R2, R3, R4, R5, R6, R7]. The paper does not compare with them and does not provide the advantage over these methods. Why would I train if I have other training-free methods?
- The method goes somehow opposite of the current advancamaents in diffusion/timestep distillation to reduce the number of timesteps. With 28 denoising timesteps, the proposed method requires 28 × 3 = 84 velocity-field evaluations per generated image. I dont think that's a clever solution.
[R1] Temporal Concept Dynamics in Diffusion Models via Prompt-Conditioned Interventions
[R2] Localizing Knowledge in Diffusion Transformers
[R3] Training-Free Layout Control with Cross-Attention Guidance
[R4] Stable Flow: Vital Layers for Training-Free Image Editing
[R5] Prompt-to-Prompt Image Editing with Cross Attention Control
[R6] Training-Free Multi-Concept Image Editing
[R7] SliderEdit: Continuous Image Editing with Fine-Grained Instruction Control\
Questions for authors
The paper is interesting but has major flaws. See weaknesses. For that reason, sadly enough, my decision will be negative.
3 comments
Concern: why train a field when PCI needs no training? PCI (Görgün et al., 2026) switches from the user's prompt to a target prompt after k of the 28 denoising steps, which requires a ground-truth target prompt for every image as an extra input, whereas AcFlow takes only the user's prompt and a concept text. The comparison is therefore not like-for-like, and PCI has two limits: (1) its strength is not continuous, as the style results show; (2) it needs a clean target prompt, which often does not exist, as for suppression. We agree that PCI should have been cited; it is now in Sec. 2 (lines 113–115). We ran it on both tasks under our protocols (same cells, initial noise and scorers).
(1) Style: PCI's control is not continuous. Here the target is the styled prompt, which the paper reports as a reference (Table 2), and PCI's strength is discrete: only the first few switch steps matter (k ≥ 6 moves style only from 0.154 to at most 0.198). Its usable levels and AcFlow's horizons on the Fig. 3 grid:
| Method | Setting | Style |
|---|---|---|
| FLUX.1-dev | – | 0.154 |
| PCI | k = 4 / 3 / 2 / 1 / 0 | 0.245 / 0.293 / 0.363 / 0.476 / 0.548 |
| AcFlow | T = 0.8 / 1.0 / 1.2 / 1.4 / 1.6 / 1.8 / 2.0 / 2.5 | 0.353 / 0.402 / 0.450 / 0.480 / 0.500 / 0.519 / 0.536 / 0.562 |
PCI offers only these five levels, with jumps of up to 0.11 in style between neighbours; finer settings would need more denoising steps, and nothing goes beyond the styled prompt. AcFlow's horizon is a real number: any T is valid, and T = 2.5 goes beyond the styled prompt (0.562 vs 0.548). Even where a target prompt exists, PCI therefore offers a few fixed settings rather than a continuous strength.
(2) Suppression: a clean target prompt often does not exist. The target must be a clean prompt that no longer implies the concept, and such a prompt is hard to write: deleting the concept's words often leaves context that still implies it. This is the difficulty reported in Sec. 4.2 (lines 363–366; examples in App. C): on our IP2P set, even the concept-free caption still yields the concept for 28.9%/15.6% of prompts. On those prompts, PCI is bounded by its target: it removes the concept in 25.6/30.4%, against 60.5/73.9% for AcFlow at T = 3 (95% CIs [14.0, 39.5] / [13.0, 47.8] vs [46.5, 74.4] / [56.5, 91.3]). Negative prompting, the inference-only method with the same input as AcFlow, collapses before it suppresses (31.0/36.6% at MUSIQ −29).
References
- Görgün A, Sammani F, Deligiannis N, et al. Temporal concept dynamics in diffusion models via prompt-conditioned interventions[C]//International Conference on Learning Representations. 2026, 2026: 66640-66669.
Concern: training-free editing methods [R2–R7]. The review groups six methods that address different tasks; only one of them applies to our setting, text-to-image generation with a DiT from text input alone. [R2] and [R7] trains (factual mistake 3). [R6] and [R7] edit a given input image. [R3] and [R5] manipulate the cross-attention layers of U-Net models, which DiTs replace by joint updates of text and image states (lines 51–53); [R3] also needs bounding boxes. The remaining one, Stable Flow [R4], is the FLUX-native training-free editor, and we ran it on our benchmarks: it runs a parallel source branch (+84% latency), reaches style 0.274 on the style grid (FLUX 0.154; AcFlow T = 0.8: 0.353), and removes the concept in 21.8/26.8% of IP2P images (AcFlow T = 2: 57.0/54.2%). The paper also compares against the training-free negative prompting and SLD (Schramowski et al., 2023) in App. G/H.
Concern: 84 field evaluations versus step distillation. Reducing the number of steps targets latency, and AcFlow adds little: +5.0% FLOPs and +6.1% latency in total (App. A, Table 4, lines 723–734), because each evaluation is a single transformer block on the image tokens (0.30T FLOPs, 1.7% of one DiT forward pass; lines 706–708). The field is evaluated N times per denoising step, so its share of the cost stays about the same when the number of steps is distilled.
Concern: content decreases as strength increases. CLIP penalizes correct stylization: the ground-truth MegaStyle images, i.e. the intended outputs for the same content prompts and style descriptions, score 0.290 CLIP versus 0.302 for unstylized FLUX. At T = 2, AcFlow is 0.022/0.018 CLIP below unstylized FLUX (held-in/held-out), and the ground truth itself is already 0.012/0.014 below. VQAScore (Lin et al., 2024) even rates the ground truth above unstylized FLUX (0.929 vs 0.856). What matters is how much content a method keeps at a given style, and in the high-style regime AcFlow keeps the most among the methods compared in the paper (Table 2 and Fig. 3, lines 270–276). The "40% failures" cited in the review is not a content measure: it is the share of images in which a strict judge still finds the concept at T = 2, down from 95.3%/82.1%, and the content cost of this suppression is about 0.015 CLIP and 2 MUSIQ points (lines 358–361). The remaining change of composition is stated as a limitation (lines 483–485).
References ([R1]–[R7] are the references of the review.)
- Lin Z, Pathak D, Li B, et al. Evaluating text-to-visual generation with image-to-text generation[C]//European Conference on Computer Vision. Cham: Springer Nature Switzerland, 2024: 366-384.
- Schramowski P, Brack M, Deiseroth B, et al. Safe latent diffusion: Mitigating inappropriate degeneration in diffusion models[C]//2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2023: 22522-22531.
We thank the reviewer for noting that the method is simple and elegant and that activation flow is preferable to fixed steering. The review contains three factual mistakes, which we correct first; we then address the other concerns one by one. Line numbers refer to the revised PDF.
Comment 1: "it actually trains on [R1] method"; "the training of the controller in the authors work - which is fully borrowed from [R1]".
Fact: [R1] switches the prompt at a chosen denoise step along the trajectory; AcFlow is trained by velocity distillation, not by prompt switching. Each training step only matches velocities at a single noise level (Eqs. 8–11, lines 232–245), and no denoising trajectory is run. This distillation target is that of Concept Ablation (Kumari et al., 2023) and, with negative guidance, of ESD (Gandikota et al., 2023), published more than two years before [R1].
Comment 2: "The paper further borrows concepts from [R1] such as using VLMs to judge if a concept is present or not."
Fact: Judging concept presence with a VLM is standard practice in text-to-image evaluation and predates [R1], e.g. TIFA (Hu et al., 2023) and VQAScore (Lin et al., 2024). We use the judge model of the Holistic Unlearning Benchmark (HUB; Moon et al., 2025), and App. H applies HUB's official evaluator directly.
Comment 3: "There are many works on text-driven image editing that perform editing in a completely training-free manner [R2, R3, R4, R5, R6, R7]."
Fact: [R2] and [R7] are not training-free. Their abstracts state: "our localized fine-tuning approach enables efficient and targeted updates" ([R2], for personalization and unlearning) and "our method learns a single set of low-rank adaptation matrices" ([R7]).
References ([R1]–[R7] are the references of the review.)