- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper targets real old-photo restoration from a single damaged image, without clean references, degradation masks, or paired real supervision. It builds on a frozen Qwen-Image-Edit-2511 backbone with LoRA, and proposes two components: G12, which extracts an edit-response field from the first two denoising steps and freezes it as a target-token RoPE phase modulation for later steps; and no-reference GRPO, which adapts the editor on unpaired real photos using MUSIQ + CLIP-IQA group-relative rewards plus an SFT-anchor penalty. Claims are supported by no-reference metrics on GGT-100K OldPhoto and RealOld-74, plus a blinded 7-method human study.
Critical strengths
- Practical and well-scoped problem setting. Single-image real old-photo restoration without masks or paired targets is the right deployment assumption; the paper avoids over-relying on synthetic paired evaluation.
- G12 is conceptually interesting. Using early-trajectory response as an internal, mask-free spatial signal is a reasonable alternative to DiffEdit-style prediction difference or explicit mask conditioning.
- Honest about limitations. The authors explicitly state the field is not a damage map, that GRPO color response is not historical-color recovery, and that no-reference metrics are not independent confirmations. This is better self-calibration than many generative-restoration papers.
- Human preference study is a real asset. 31 participants, 1,018 ballots, Top-2 protocol, clustered bootstrap and conditional logit are unusually careful for this venue. EMBER’s 58.3% Top-2 rate is a meaningful signal.
- Engineering transparency. Pseudocode, field normalization, κ schedule, GRPO ratio/clipping, hardware, and bootstrap seeds are documented in unusual detail.
Critical weaknesses
- Incrementality of the core method. G12 combines early-step residual extraction [DiffEdit-like], RoPE phase offset [LooseRoPE-like], and frozen-field modulation; GRPO-on-LoRA reuses standard group-relative policy optimization . The paper reads as a competent adaptation of existing pieces rather than a new mechanism. The novelty claim should be narrowed to “early-trajectory modulation for mask-free restoration” and not overstated as a representation-level contribution.
- Weak causal evidence that G12 placement helps. The permutation intervention (Table 11) shows no significant damage-LPIPS gain from correct vs permuted field, and even a negative damage-L1 effect. The authors explain this away as “mask-defined endpoints don’t capture fading/color,” but that weakens the claim that G12 is doing useful spatial localization. The main G12-vs-non-G12 gain is also not a controlled ablation: the two rows come from different training trajectories/checkpoints, so the delta is end-to-end, not field-causal.
- Reward metrics are biased toward the method’s failure mode. MUSIQ/CLIP-IQA are known to reward high-frequency content, over-sharpening, and generative “pop” without fidelity . EMBER explicitly increases saturation/colorfulness and drops PSNR/SSIM/LPIPS after GRPO (Table 9), which is exactly the regime where these NR metrics inflate. Claiming “best or competitive on most no-reference metrics” is therefore circular unless balanced by human study or fidelity constraints — which the paper partially does, but the metrics are still over-used in the abstract.
- No-reference metrics are not “held-out” in practice. Four of five are learned IQA models that may share training-data/feature bias with CLIP-IQA/MUSIQ. The paper acknowledges this but still titles them “held-out NR metrics.” This wording overstates independence.
- Color recovery claim is vague by design. The instruction permits “natural-looking colors,” GRPO amplifies color response, but no historical-color check exists and arguably cannot exist. That is acceptable, but the paper should not imply color restoration quality beyond plausibility. The ablation also shows CLIP-IQA-only gives more color response, so the dual-IQA choice is not clearly justified except by monitor peaks.
- Full-reference degradation is large and under-discussed. On GGT-100K, EMBER(G12) gets PSNR 17.94 vs HYPIR 24.39, SSIM 0.69 vs 0.76. The paper frames this as perception-distortion tradeoff, but for old photos with identifiable people/places, identity and content fidelity matter. No face-ID retrieval, no structure-preservation metric, no “intact region” human rating.
- Human study stratification is thin. 48 photos, 4 per stratum, person/color/severity by visual inspection. Strata-level rates (Fig 12) are descriptive only; RealRestorer beats EMBER in color-present strata. The overall Top-2 win is convincing, but “EMBER restores old photos better” is stronger than the data supports for color photos.
- G12 field may encode “where model edits,” not “where damage is.” Correlation ρ≈0.31 partial is modest. Applying modulation on permuted fields barely changes LPIPS suggests the field acts more like a soft attention prior than a damage prior. The paper should clarify whether G12 is claimed to help localization or only trajectory steering.
Questions for authors
- Causal G12 ablation. Since EMBER(non-G12) and EMBER(G12) are different checkpoints/trajectories, can you report a same-anchor ablation where only the frozen field is enabled/disabled? Without it, Table 1 cannot attribute gains to G12.
- Field permutation result. Table 11 shows permuted field ≈ correct field on LPIPS and better on damage-L1. Does this mean G12’s main benefit is global phase offset rather than spatial placement? If so, is the 12×12 field unnecessarily complex?
- Reward bias. Given MUSIQ/CLIP-IQA reward sharpness/color , have you checked whether disabling the color instruction or using a fidelity-penalized reward (e.g. LPIPS-to-input or ID similarity) changes rankings?
- Leakage during SFT. The detached two-step preview avoids using x_s, but the condition latent z_y comes from the LQ image. Could the field still exploit dataset-specific LQ statistics that don’t transfer to real photos? Any real-photo field visualization?
- Identity/fidelity evaluation. Old photos often contain faces. Can you add ArcFace ID retention or a human “content preserved” rating, especially since GRPO lowers SSIM?
- Why κ=8 then 4? The taper is intuitive but unmotivated. Is there a sensitivity curve? Table 14 shows 1–4 observations are nearly identical — could G12 be simplified to a single-step global gate?
- Human study baselines. SeedEdit / Qwen-Edit are weak restoration baselines; the real competitor is RealRestorer and HYPIR. In color-present strata RealRestorer wins — do you see EMBER over-colorizing?
- Deployment cost. 8-step rollout + field estimation + LoRA is not cheap. Latency table uses synthetic 512×512; what is real-photo 1024px+ latency and memory? Is G12 actually “no extra denoiser pass” inclusive of the step-1–2 preview?
- Color correctness scope. Could you add a synthetic old-photo test with known ground-truth color to show whether GRPO color response correlates with correct color at all, or only “saturated natural-looking” output?
- Novelty statement. If DiffEdit, LooseRoPE, and Flow-GRPO already exist, what is the one claim that survives a “prior-work minus EMBER” test? I’d suggest reframing contributions around trajectory-derived mask-free modulation for restoration editors rather than generic “diffusion + GRPO.”
7 comments
[W5] Color recovery claim is vague; dual-IQA choice unclear
No historical-color check. CLIP-IQA-only gives more color response than dual-IQA, so the dual choice is not clearly justified.
Response. Real-photo claims are limited to plausible color response. Dual-IQA is treated as an evaluated operating choice, not a proven optimum. Three-seed evaluation: TOPIQ-NR 0.579 / 0.561 / 0.570 for dual-IQA / MUSIQ-only / CLIP-IQA-only. On 200 synthetic known-color sources, mean CIEDE2000 decreases from 8.9 (M-SFT) to 7.6 (M-20), supporting synthetic color improvement, not historical correctness on real photographs.
Revised locations. Table 5 (p. 23); Table H.1 (p. 25); Table L.1 (p. 36).
[W6] Full-reference degradation is large and under-discussed
GGT-100K: PSNR 17.94 vs HYPIR 24.39, SSIM 0.69 vs 0.76. No face-ID or structure-preservation metric.
Response. The gap is retained and now accompanied by direct fidelity measurements. M-20 vs M-SFT: −2.04 dB PSNR, −0.0725 SSIM, +0.0493 LPIPS.
| Measure | M-SFT | M-20 | Δ |
|---|---|---|---|
| Intact-region LPIPS (200 D-Syn) ↓ | 0.0881 | 0.0906 | +0.0025 |
| FFHQ ArcFace (100 sources) ↑ | 0.824 | 0.816 | −0.008 |
| Real-photo ArcFace (42 valid) ↑ | 0.742 | 0.733 | −0.009 [90% CI: −0.0161, −0.0018] |
| Human identity, 48 photos ↑ | 4.35 | 4.29 | −0.06 |
| Human structure, 96 photos ↑ | 4.42 | 4.38 | −0.04 |
| Human undamaged regions, 91 photos ↑ | 4.18 | 4.09 | −0.10 |
90% CI: two-sided paired-photograph bootstrap, B = 10,000, seed 20261112. Human contrasts are descriptive; no non-inferiority claim is made.
Revised locations. Table N.1 (p. 39); Table N.3 (p. 42).
[W7] Human study stratification is thin; RealRestorer wins in color-present strata
Overall Top-2 win is convincing, but "EMBER restores better" is too strong for color photographs.
Response. We have narrowed the claim. Original stratified counts: without usable color, EMBER 332/508 (65.4%) vs RealRestorer 167/508 (32.9%); with usable color, EMBER 261/510 (51.2%) vs RealRestorer 270/510 (52.9%).
Task C head-to-head on RealNew-96 (1,920 ballots, 32 participants): M-20 vs RealRestorer overall 57.4% [53.3, 61.5]; without usable color 66.1% [60.2, 71.8]; with usable color 48.8% [43.3, 54.2]; subset difference 17.3 pp [8.8, 25.4]. The advantage is concentrated in photographs without usable input color.
Revised locations. Table N.4 (p. 42); Figure N.1 (p. 43).
[W8] G12 field may encode "where model edits," not "where damage is"
Partial Spearman ρ ≈ 0.31 is modest. Clarify whether G12 is claimed to help localization or trajectory steering.
Response. G12 is an edit-response signal. We do not claim it estimates damage probability or provides accurate damage localization. Original diagnostic: partial ρ = 0.3072, AUPRC = 0.1794, AUROC = 0.5444 — these support association with subsequent editing, not damage detection. Sections 2.2 and 3.5, Appendix K, and visualization captions now distinguish edit response from damage.
Revised locations. Appendix K (p. 27); Figure 11 (p. 28); Figure P.1 (p. 44).
[Q1] Same-anchor ablation: enable/disable frozen field from the same checkpoint
EMBER(non-G12) and EMBER(G12) are different checkpoints. Without a same-anchor ablation, Table 1 cannot attribute gains to G12.
Response. The fixed-checkpoint Table 11 is unchanged (inconclusive LPIPS; damage-L1 favors permutation). New matched arms share identical initialization — but the field controls operate during both SFT and GRPO, so post-SFT checkpoints differ by arm; this is not a GRPO-only experiment from one shared post-SFT anchor. See W2 for the full matched-training and fixed-weight causal-path results.
The fixed-weight probe on M-20 (held weights, noise, all other cells fixed): attention density change +0.04779 [0.04084, 0.05473], positive in all 20 photographs; all 16 phase-boundary crossings change reconstruction; all 4 same-bin controls produce zero change.
Revised locations. Appendix K.1 (p. 27); Table K.1 (p. 29); Figure 5 (p. 8); Appendix K.3 (p. 30).
[Q2] Permutation result: global phase offset or spatial placement?
Table 11: permuted ≈ correct on LPIPS, better on damage-L1. Is the 12×12 field unnecessarily complex?
Response. The global-phase explanation remains open. Original Table 11 unchanged. New global-only inference probe on the 100-image diagnostic: damage-LPIPS gain 0.0436, intact LPIPS 0.0901, vs deployed 0.0458 / 0.0885. Observation-window summary:
| Configuration | Damage-LPIPS ↑ | Intact LPIPS ↓ |
|---|---|---|
| Deployed κ=8→4, two observations | 0.0458 | 0.0885 |
| Fixed κ=8, two observations | 0.0459 | 0.0912 |
| Fixed κ=4, two observations | 0.0452 | 0.0888 |
| κ=8→4, one observation | 0.0457 | 0.0888 |
| Global-only field | 0.0436 | 0.0901 |
Constant field cannot exclude all global-phase explanations (quantized mapping). These single-checkpoint probes do not establish formal equivalence or optimal resolution.
Revised locations. Appendix K.1 (p. 27); Table K.1 (p. 29); Table M.1 (p. 38).
[Q3] Instruction removal and fidelity-penalized reward
Have you checked whether disabling the color instruction or using a fidelity-penalized reward changes rankings?
Response. Both tested. Three-seed reward-control evaluation (mean ± SD, n=3):
| Objective | TOPIQ-NR ↑ | FFHQ ArcFace ↑ | ΔSaturation |
|---|---|---|---|
| Dual-IQA, β=0.01 | 0.579 ± 0.006 | 0.816 ± 0.003 | +0.0382 ± 0.0012 |
| MUSIQ-only | 0.561 ± 0.007 | 0.815 ± 0.002 | +0.0204 ± 0.0010 |
| CLIP-IQA-only | 0.570 ± 0.005 | 0.807 ± 0.004 | +0.0341 ± 0.0011 |
| Dual-IQA, β=0 | 0.586 ± 0.008 | 0.796 ± 0.003 | +0.0423 ± 0.0014 |
| Dual-IQA + ID/struct | 0.572 ± 0.005 | 0.823 ± 0.003 | +0.0281 ± 0.0008 |
Fidelity terms improve the ArcFace diagnostic but reduce TOPIQ-NR. This is a quality–fidelity tradeoff, not a Pareto improvement. Paired seed differences (dual+ID/struct minus dual): TOPIQ-NR −0.006/−0.007/−0.008; ArcFace +0.006/+0.009/+0.006.
Instruction removal (inference-only, fixed M-20): saturation gain 0.0390 → 0.0114; damage-LPIPS gain unchanged (0.0458 → 0.0457). This measures inference-time instruction sensitivity, not training mechanism.
Revised locations. Appendix B.1 (p. 17); Table H.1 (p. 25); Table H.2 (p. 25); Figure L.1 (p. 36).
We thank the reviewer for the detailed assessment across methodology, causal evidence, reward bias, and metric independence.
[W1] Incrementality of the core method
Response. We have narrowed the claim to restoration-specific early-trajectory modulation and its field-replayed optimization protocol. G12 constructs an online edit-response field from early clean-latent estimates under one restoration instruction, gates temporal agreement, freezes the field, and applies it to later target-token frame-axis phases. We do not claim a new residual operator, rotary-embedding family, or policy optimizer.
Revised locations. Section 1 (p. 2); Appendix A (p. 16); Appendix F (p. 21).
[W2] Weak causal evidence; negative intervention result
Response. We retain the negative result. The original Table 11 is unchanged: neither primary LPIPS endpoint is significant; damage-L1 favors permutation (effect −3.128, 95% CI [−5.233, −1.229], p = 0.0021). New matched controls complement without reversing this.
Matched training (Table K.1, p. 29) — four arms, identical init/data/noise/budget:
Seed differences (correct − permuted): 0.0024 / 0.0028 / 0.0029 (mean 0.0027). Constant field cannot exclude all global-phase explanations (phase mapping is quantized).
Fixed-weight causal-path probe (Figure 5, p. 8; Appendix K.3, p. 30). Holding M-20 weights, noise, and all other cells fixed, changing only single cell phases: attention density change 0.04779 [0.04084, 0.05473], positive in all 20 photographs. All 16 phase-boundary crossings change reconstruction; all 4 same-bin controls produce zero change. This establishes a causal path through deployed RoPE without attributing quality improvement to it.
Revised locations. Appendix K.1 (p. 27); Table K.1 (p. 29); Figure 5 (p. 8); Appendix K.3 (p. 30); Table K.3 (p. 31).
[W3] Reward metrics biased toward the method's failure mode
Response. The revised abstract pairs NR metric results with independent-set human preference and adverse fidelity findings. Controlled 0.75×→1.25× chroma contrast: CLIP-IQA +0.0061 [+0.0037, +0.0084], MUSIQ +0.31 [−0.06, +0.68]. Full-reference degradation remains explicit. Added identity/structure reward terms improve ArcFace but reduce TOPIQ-NR from 0.579 to 0.572. Human fidelity ratings shift adversely. We do not present these as eliminating reward exploitation.
Revised locations. Appendix H.1 (p. 24); Table H.1 (p. 25); Table N.3 (p. 42); Section 4 (p. 10).
[W4] "Held-out NR metrics" overstates independence
Response. We replaced "held-out NR metrics" with "non-reward NR metrics" throughout. The Table 1 caption now names the excluded rewards, states that four of five non-reward metrics are learned and may share feature or dataset biases with MUSIQ and CLIP-IQA, and identifies NIQE as handcrafted.
Revised locations. Table 1 (p. 5); Section 4 (p. 10).