- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies layer-wise feature discrepancies between diffusion reconstruction trajectories and independently sampled forward references. It defines the normalized depth profile as an “architecture accent” and identifies recurring profile shapes across diffusion backbones. The experiments examine stability across model variants and measurement settings, dependence on feature norms, responses to architectural interventions, and emergence during training. The paper also explores using these profiles to select feature-correction sites. The main evaluation uses 104 COCO images, with an additional 121 editing examples drawn from those images.
Critical strengths
The paper includes substantial controls across architectures, model variants, reference seeds, measurement conventions, and inversion frameworks. In particular, the norm-free analyses and exact-inversion controls help clarify what the proposed discrepancy measures. The authors also acknowledge several important limitations, including norm dependence, architecture-specific intervention effects, and the restricted interpretation of the editing results. This makes the observations more informative than an uncontrolled collection of feature visualizations.
Critical weaknesses
1. The additional diagnostic value of the proposed accent is not sufficiently established.
The paper demonstrates reproducible profiles, but it is less clear what useful information these profiles provide beyond simpler feature statistics. Section 3.1 and Appendix C.9 show that the terminal-ramp morphology is largely carried by the feature-norm schedule and does not retain its ramp label under norm-free metrics. Appendix F further reports that drift and reference norm select identical top-five layers in six of seven measured models. The interior-localized profiles surviving normalization are interesting, but the paper still needs to establish what the proposed measurement enables us to predict or do beyond inspecting feature norms.
The correction experiments make this concern concrete. Table 3 reports the following PSNR improvements under matched layer count, injection strength, and reconstruction steps:
| Site-selection strategy | λ = 0.7 | λ = 0.3 |
|---|---|---|
| Accent / drift top-five | +3.478 | +3.415 |
| Reference-norm ranks 6–10 | +3.568 | +3.432 |
| Evenly spaced layers | +3.418 | +3.238 |
| Random layers, mean over ten seeds | +3.441 | +3.217 |
Accent selection trails the norm-based alternative at both strengths. At λ = 0.7, it falls within the random-selection range, with five of ten random sets outperforming it. Separately, latent correction without accent-based site selection achieves +3.67 dB, compared with approximately +3.48 dB for accent-based feature correction. The authors acknowledge that most of the gain comes from correction itself.
The HunyuanDiT result demonstrates sensitivity to the chosen site, but both compared sites are drift-derived, and the selection/evaluation overlap remains unresolved for that model. It therefore does not establish an advantage over simple alternative selection rules. Overall, the observations support reproducibility more clearly than they establish the accent’s incremental diagnostic or practical value.
2. The downstream evaluation is too limited to establish usefulness for reconstruction and editing.
The main experiments use a fixed set of 104 COCO images, and the 121 editing examples also come from this set. The paper discusses PIE-Bench and EditBench but does not report systematic evaluation on them. Its comparisons across many backbones establish the breadth of the measurement study; they do not establish whether accent-guided correction improves representative reconstruction or editing pipelines under comparable conditions. The exact-inversion experiments are useful controls for the measured phenomenon, but they do not resolve this downstream question.
More importantly, Appendix F explicitly states that semantic agreement of the edits is not measured. The reported 85% LPIPS reduction therefore establishes improved fidelity to the source image, without showing that the requested edits are successfully performed. Stronger anchoring could preserve the original image while weakening the edit. Without evaluating both edit success and content preservation, the practical interpretation of this result remains unclear.
Together, these limitations leave a substantial gap between identifying a stable measurement pattern and demonstrating useful guidance for existing methods.
Questions for authors
- What specific predictive or diagnostic capability does the accent provide beyond a reference-feature-norm profile? Which results establish this additional capability?
- Given the matched-budget results in Table 3, what evidence supports using accent-based site selection over norm-based selection or correction without site selection? Is there an independently evaluated case where the advantage is clear?
- Is there evidence that accent-guided correction improves semantic editing success as well as source-image fidelity, relative to representative editing methods on a standard benchmark?
These questions concern the interpretation and significance of the current results, and their answers could materially affect my assessment.
2 comments
Supplement to Q3 — Standard-benchmark evaluation
As a supplement to our previous response on Q3, we have completed an evaluation on a 120-edit sample of PIE-Bench++, measuring target-prompt alignment and source-image preservation jointly. The sample contains 30 edits each of object change, object addition, object deletion, and attribute change, drawn with a fixed seed. We invert with the source prompt and reconstruct with the target prompt, applying correction at five layers with λ = 0.1 over the last 20 of 50 steps.
Alignment is the cosine between the image-direction and text-direction vectors, cos(CLIP(edited) − CLIP(source), CLIP(target) − CLIP(source)); preservation is measured by whole-image PSNR and LPIPS against the source image. The mirror copy of PIE-Bench++ does not ship usable masks, so preservation is measured on the whole image rather than inside and outside the edit region.
| Arm | ΔCLIP-Dir [95% CI] | ΔPSNR, dB [95% CI] | LPIPS reduction |
|---|---|---|---|
| Drift5 | −0.0113 [−0.0172, −0.0060] | +0.522 [0.484, 0.560] | +0.0367 |
| Norm5 | −0.0101 [−0.0151, −0.0054] | +0.499 [0.462, 0.537] | +0.0350 |
| Uniform5 | −0.0137 [−0.0200, −0.0080] | +0.713 [0.668, 0.757] | +0.0521 |
| Random5, three fixed sets | −0.0080 to −0.0047 | +0.209 to +0.457 | +0.015 to +0.032 |
LPIPS reduction is measured against the no-correction baseline, so larger values are better. Drift5 closely matches Norm5 in mean PSNR gain (+0.522 versus +0.499 dB) and achieves higher per-edit PSNR on 114 of 120 edits. Drift5 also gives higher per-edit PSNR than each fixed random set on 101 to 119 of 120 edits, with mean paired advantages of +0.06 to +0.31 dB and a +0.174 dB advantage over the three-set mean. The PSNR ordering Uniform5 > Drift5 > Norm5 > the random-set mean appears in all four edit types. Uniform5 yields a larger preservation gain (+0.713 dB) at a larger alignment cost (−0.0137 against −0.0113 for Drift5).
Together with the previously reported 121-pair grid, every reported correction setting increased source-image PSNR. The standard-benchmark sample further demonstrates that accent-guided correction provides consistent source-preservation gains over fixed random site selection, while matching norm-based selection and trading a smaller alignment cost for a smaller preservation gain than even spacing.
On Q1, the accent analysis provides complementary quality-diagnostic and representation-level information. On 100 held-out SD 2.1 images, a post-hoc feature ablation gives the following results:
The quality-prediction gains above are attributable to mean drift. Separately, decomposing squared drift provides depth-resolved, representation-level diagnostics:
These architecture-dependent composition patterns are not available from a reference-norm profile alone.
On Q2, disjoint evaluation confirms substantial fidelity gains from accent-guided correction.
We froze site lists on 104 calibration images and evaluated on separate images. Drift-selected correction improved PSNR by +3.676 dB on SD 2.1 and +2.99 dB on HunyuanDiT, with both 95% CIs excluding zero. All reported correction conditions improved source fidelity on both models. These results independently reproduce substantial correction benefits under a disjoint selection–evaluation protocol. Latent correction is a separate comparison. One HunyuanDiT evaluation image was previously used for an implementation check.
On Q3, we evaluate target-prompt alignment and source preservation jointly. Rather than inferring editing success from fidelity alone, we measure CLIP image-text alignment against the target prompt (CLIP_T) alongside PSNR, on 121 controlled edit pairs.
All reported correction settings increased source-image PSNR. Among the corrected arms, late-window drift5 (λ = 0.1) retained the highest target-prompt alignment (CLIP_T = 0.2367), with the smallest alignment change (−0.0100), while increasing PSNR by 0.495 dB. The complete grid maps the fidelity–editing trade-off and identifies a low-strength operating point that best preserves target alignment among the tested corrections.