- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Direct Latent Editing (DLE) for image generators operating in the latent space of a frozen vision foundation model. For each concept, the method generates samples from positive and negative prompts using shared initial noise and averages their latent differences. Editing then consists of encoding an image, adding the precomputed direction, and decoding. No flow-model evaluation or inversion is required at edit time. The experiments cover CelebA, MIMIC-CXR, and ADNI-1 using separately trained generators. DLE substantially outperforms the adapted baselines on the reported target metrics within these models. The paper also studies alternative direction estimators, different encoders, prompt wording, and a matched VAE generator. Online editing is inexpensive, although each concept requires offline direction extraction.
Critical strengths
1.The method is simple and has a clear practical advantage when the same concept is used repeatedly. Once a direction has been computed, editing requires only an encoder pass, a latent addition, and a decoder pass. Appendix F provides useful timing details, including the precomputation cost and amortization point.
2.The CelebA improvement is not solely an artifact of measuring target accuracy. In Table 9, DLE achieves 65.4% successful edits that also pass the identity threshold, compared with 18.0% for FlowEdit in the authors’ VFM generator. The independent attribute classifier provides additional support for the observed changes.
3.The paper includes several useful controls and reports negative findings openly. Development-set tuning, independent evaluators, alternative encoders, prompt variations, and the unsuccessful transfer to SVG-T2I all help establish what the experiments do and do not show.
Critical weaknesses
Weaknesses
1. The methodological contribution is limited, and the closest alternatives are not compared convincingly.
Section 5 correctly acknowledges that latent translation is not new. However, the remaining claim about the “paired-endpoint estimator” is not particularly convincing. Equation (1) is exactly the difference between the positive and negative sample means:
Shared initial noise may reduce estimation variance, but the paper does not isolate that benefit through a comparison with independent-noise sampling. It also does not compare against a direction obtained from the mean encoded features of real positive and negative examples. That comparison would help establish whether the expensive flow-model sampling stage is necessary.
The comparison with SVM and PCA directions is also incomplete. Appendix B.2 specifies norm matching for the random control but does not clearly explain the scale convention for the SVM and PCA directions. Comparing them at the same numerical value of α does not necessarily compare equivalent edit strengths. The reported advantage over SVM should be tested with separately calibrated strengths and an identity-preserving success metric.
2. The results do not establish what makes DLE work beyond the authors’ own generators.
Appendix B.8 is particularly important. On the released SVG-T2I model, which also uses a frozen DINOv3 encoder, DLE reaches only 25.7% target accuracy, compared with 64.0% for FlowEdit. Joint target-and-identity success is low for both methods, at 9.1% and 6.9%. The authors acknowledge this limitation, but it substantially narrows the contribution.
The explanation in Section 3.4 does not resolve this discrepancy. Better linear separability and higher translation consistency support the possibility of additive editing; they do not explain why trajectory-based editors should fail. The VAE comparison changes the encoder, decoder, and trained flow model together, as the paper itself notes. It therefore cannot identify which component causes the observed behavior.
The successful datasets also have relatively standardized spatial layouts. Since DLE applies the same spatial tensor to every source image, robustness to changes in pose, position, and cropping would be informative. At present, the conditions under which the method should be expected to work remain unclear.
3. The baseline experiments do not adequately support the explanation for their failure.
The paper does tune several baselines, so the concern is not simply a lack of tuning. Rather, SDEdit and FlowEdit select the strongest temporal settings included in their respective search grids. FlowEdit is capped at with , although its original formulation allows and explicitly identifies longer editing paths with stronger edits. The SD3 operating point is not a methodological upper bound. A broader sweep is needed before attributing the near-identity outputs to VFM latent geometry. See FlowEdit, Section 5.1.
Source preservation also changes the interpretation of the VAE comparison. In Table 9, official FlowEdit achieves 86.0% target accuracy but only 15.4% joint target-and-identity success, below DLE’s 36.3%. The searched FlowEdit setting instead reaches 49.4% joint success. Thus, the claimed reversal between VFM and VAE generators depends substantially on the operating point and evaluation criterion. Curves showing target success against source preservation would be more informative than the selected accuracy comparisons.
4. The medical experiments mainly establish changes in classifier scores, rather than valid edits of the intended findings.
The headline CXR AUROC of 0.927 compares classifier scores for edits toward and away from a finding. It does not directly establish that the corresponding pathology has been introduced or removed correctly. This distinction matters because Table 19 reports a mean SSIM of 0.64 at α=3, and the qualitative examples show changes spread across substantial portions of the image.
The independent CXR classifiers are useful controls, but agreement between classifiers does not establish anatomical specificity. The cross-talk analysis is performed at α=1 on an earlier checkpoint, whereas the main results use α=3 on the final checkpoint. Appendix B.3 also states that structural preservation was not measured. The paper therefore lacks a direct assessment of selectivity at its main operating point.
The MRI evidence is weaker still. The evaluator achieves 42.5% three-class test accuracy, and its MCI discrimination is near chance. Including the MCI direction in the headline average makes that result difficult to interpret. The authors disclose these limitations and avoid clinical claims, but the reported scores remain insufficient evidence of reliable disease-related editing.
5. The CXR test protocol does not establish generalization to patients unseen during generator training.
Appendix A.1 states that the flow model and decoder were trained on a pool containing most of the evaluation sources. The patient-disjoint development/test split protects hyperparameter selection, but it does not make the test patients independent of generator training.
Comparing toward and away edits of the same source controls their shared starting point. It does not address whether the method works equally well on unfamiliar patients. Given the prominence of the CXR results, an evaluation on patients excluded from both flow-model and decoder training is needed. Without it, the scope of the claimed held-out performance is narrower than the main tables initially suggest.
Questions for authors
How much does shared-noise sampling improve the direction estimate compared with independent-noise sampling? How does DLE compare with mean-difference directions computed from encoded real images, and with SVM directions after separate strength calibration?
Do SDEdit and FlowEdit remain ineffective when their editing windows are extended beyond the current search boundaries? Please compare target success at matched source preservation.
What accounts for the failure on SVG-T2I? Which architectural or training conditions distinguish the successful generators from this model, and how sensitive is the fixed spatial direction to pose or spatial misalignment?
Can the medical experiments be repeated on patients excluded from generator training, with direct checks of anatomical preservation and a more reliable MRI evaluator? The MRI uncertainty estimates should also reflect variation across subjects, rather than only resampling the direction-extraction pool.
Please clarify the sign convention in the CelebA evaluation. Appendix A.6 says negative edits are evaluated against negative targets, whereas Appendix B.2 describes negative α as a wrong-direction control. An explicit definition of how source labels, target labels, and α determine each reported accuracy would resolve this ambiguity.