- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes PhoenixSR, a framework for transferring pretrained diffusion-model priors into existing feed-forward super-resolution networks without modifying their inference architectures. The method applies distribution matching distillation in the latent space of Stable Diffusion 2.1, using a real-score model and an online fake-score model to supervise student outputs. Also, the paper proposes two main components: 1) HDA: The real-score model is adapted to the target HR distribution using LoRA, while the fake-score model is regularized through representation alignment with DINOv3 features. 2) DRW: The distribution-matching objective is reweighted according to the directional consistency of denoising residuals around generated and HR latents.
Critical strengths
-
Practical motivation: Transferring diffusion-based supervision into existing feed-forward SR networks is a practically relevant problem. PhoenixSR does not require changes to the student architecture or additional diffusion computation at inference time. Its applicability to CNN, Transformer, and lightweight SR backbones is an important strength.
-
Broad empirical evaluation: The experiments cover six student networks, three benchmarks, and multiple reconstruction and perceptual metrics. The supplementary material further includes three-seed experiments for two students and a user study with statistical analysis. This provides reasonably broad evidence of the method's effectiveness, although the robustness experiments cover only a subset of the reported settings.
-
Controlled comparison with alternative transfer strategies: Table 4 compares PhoenixSR against task-only fine-tuning, output-level knowledge distillation, SDS, and DMD2-based transfer under a common initialization, dataset, and student-update budget. Including a strong task-only fine-tuning baseline is particularly valuable because it helps distinguish the effects of diffusion-based supervision from ordinary continued training.
Critical weaknesses
-
Novelty: The framework combines established components: DMD-style real/fake score matching, LoRA adaptation, representation alignment, paired reconstruction losses, timestep restriction, and sample-wise reweighting. The individual technical components are largely adaptations of existing approaches, and the paper offers limited analysis of why their combination is particularly effective.
-
Effects of each component: The main results in Tables 1–3 compare PhoenixSR against the original student checkpoints. However, these comparisons do not establish how much improvement comes specifically from diffusion-prior transfer rather than additional paired SR training. Table 4 includes an equal fine-tuning baseline, but only for three students on RealSR under an 80K-iteration setting. The authors explicitly note that these results are not directly comparable to the full-schedule experiments.
-
Performance: The controlled results show substantial, but smaller, gains over task-only fine-tuning. For example, PhoenixSR improves MUSIQ from 56.0 to 63.4 for SwinIR-S and from 53.7 to 61.5 for SeeMoRe. These are meaningful improvements, but they should be distinguished from the larger gains reported relative to the original checkpoints. The reconstruction results are also mixed. In Table 4, PhoenixSR slightly improves PSNR over task-only fine-tuning for SwinIR-L and SwinIR-S, but reduces it for SeeMoRe. Table 5 further shows that SFA-only training has almost no effect on SwinIR-L PSNR in the controlled setting, although this does not establish its contribution over the full schedule. More discussion on this issue would be beneficial.
-
Non-reference-based metrics-oriented: Most of the reported perceptual improvements are measured using no-reference image-quality metrics, including MANIQA, MUSIQ, CLIP-IQA, LIQE, ARNIQA, TOPIQ, and NIQE. These metrics are useful for evaluating perceptual quality but do not directly establish whether generated details are faithful to the input scene. The diffusion teacher is also conditioned on a fixed quality-oriented prompt, potentially encouraging visually appealing high-frequency details. This makes the distinction between faithful restoration and plausible texture generation particularly important. There are also exceptions to the reported fidelity and perceptual trends, including a PSNR decrease for HAT on DIV2K-Val and small regressions in certain no-reference metrics for Real-ESRGAN.
-
Effects of DRW: The authors motivate DRW as a mechanism for identifying reliable distribution-matching guidance. Tables 9 and 10 show that the proposed residual-direction consistency score correlates with guidance stability under independently sampled diffusion perturbations. This supports its use as a proxy for directional stability. However, the reliability and the stability are both based on related directional properties of the score-model guidance. Their correlation does not directly establish that samples receiving higher weights produce more beneficial student updates or improve reconstruction fidelity.
Questions for authors
- Perceptual fidelity: Can the authors provide additional reference-based perceptual evaluation, such as DISTS, together with an assessment of hallucinated details or faithfulness to the LR input?
5 comments
Q2. Full-training experiments do not distinguish the contributions of diffusion-prior transfer and additional paired training
The total gains relative to the original checkpoint and the incremental gains after controlling for additional training should be addressed using different references. Tables 1–3 show the changes in students after full training relative to their original checkpoints. Table 4 compares PhoenixSR with task-only fine-tuning under the controlled 80K setting on RealSR, using the same initialization, training data, paired task supervision, and student-update budget. The latter has already demonstrated perceptual gains beyond ordinary continued training on SwinIR-L, SwinIR-S, and SeeMoRe.
Following your suggestion, we add a task-only fine-tuning comparison under the full training schedule. Each student starts from the same checkpoint and uses the same training data, paired task supervision, number of student updates, and model-selection rule, and is compared with the corresponding PhoenixSR result on RealSR.
| Student | Method and data source | PSNR ↑ | LPIPS ↓ | MUSIQ ↑ |
|---|---|---|---|---|
| SwinIR-L | Task-only fine-tuning (additional comparison) | 26.07 | 0.282 | 58.24 |
| SwinIR-L | PhoenixSR (Table 1 of the paper) | 26.74 | 0.250 | 61.36 |
| SwinIR-S | Task-only fine-tuning (additional comparison) | 25.07 | 0.342 | 60.40 |
| SwinIR-S | PhoenixSR (Table 1 of the paper) | 25.25 | 0.303 | 65.34 |
| SeeMoRe | Task-only fine-tuning (additional comparison) | 24.98 | 0.309 | 57.83 |
| SeeMoRe | PhoenixSR (Table 1 of the paper) | 25.93 | 0.266 | 62.41 |
With the full training budget matched, PhoenixSR achieves higher PSNR and MUSIQ and lower LPIPS on SwinIR-L, SwinIR-S, and SeeMoRe. In particular, SeeMoRe's PSNR also increases from 24.98 to 25.93 dB, together with improvements in perceptual metrics. This shows that, in the evaluated setting, PhoenixSR's gains cannot be attributed solely to additional paired SR training. With distributional-prior transfer added, students obtain further reconstruction and perceptual gains, and this effect is also observed on lightweight students with approximately 1M parameters. This full-training comparison and the controlled comparison in Table 4 under the 80K setting complement each other, with each quantifying the incremental gains beyond ordinary continued training under the corresponding training budget.
Q3. Controlled gains and overall gains should be distinguished, and the inconsistency of reconstruction performance improvements should be discussed
The paper has separately reported the incremental gains beyond ordinary continued training in Table 4 and explicitly distinguished them from the overall changes relative to the original checkpoint. Smaller controlled gains than overall changes do not contradict the method's effectiveness. This is precisely the purpose of including a continued-training baseline and separating the sources of gains. Under the same student-update budget, PhoenixSR's results relative to task-only fine-tuning are as follows:
| Student | PSNR change | LPIPS change | MUSIQ change |
|---|---|---|---|
| SwinIR-L | +0.03 | −0.013 | +4.6 |
| SwinIR-S | +0.08 | −0.014 | +7.4 |
| SeeMoRe | −0.07 | −0.010 | +7.8 |
LPIPS and MUSIQ improve for all three students, while PSNR also improves for SwinIR-L and SwinIR-S. SeeMoRe's PSNR decreases by 0.07 dB, while LPIPS decreases by 0.010 and MUSIQ increases by 7.8, reflecting this student's reconstruction-accuracy and perceptual-quality trade-off under the 80K setting. This local trade-off cannot directly represent performance after full training. In the added comparison with matched full training budgets, PSNR, LPIPS, and MUSIQ all improve for SwinIR-L, SwinIR-S, and SeeMoRe, with SeeMoRe's PSNR increasing from 24.98 to 25.93 dB. The full-budget comparison therefore directly answers this question: these gains are not brought about solely by additional paired training, and all three evaluated students obtain further reconstruction and perceptual improvements.
The incremental gains from continued training with SFA alone should likewise be distinguished from its constraining role in distributional distillation. In Table 5, the PSNR values of SFA-only and the base SwinIR-L are 26.3124 and 26.3071 dB, respectively. However, removing SFA while retaining distributional distillation and the other components reduces PSNR from 26.4409 for the full method to 20.7107 dB. This is because the two types of supervision serve different purposes. Distribution matching introduces distributional priors from HR images, while SFA constrains the paired correspondence between the content of each output and its corresponding input. Limited gains from continuing to optimize the reconstruction objective alone for a student that has already undergone paired training do not imply that this constraint can be omitted when new distributional supervision is introduced. The existing ablation directly supports SFA's role in preserving fidelity during joint training.
The existing evidence shows both improvements in outputs relative to the original models and additional gains from PhoenixSR after controlling for the continued-training budget. The 80K comparison illustrates the specific trade-offs under that setting, while the full-budget comparison further verifies simultaneous reconstruction and perceptual improvements for all three students. The method's contribution should be assessed through these comparisons under matched conditions, and should not be generalized solely from a decline in a single metric under a particular setting.
Q1. Insufficient analysis of the effectiveness of combining existing components
Using existing techniques does not imply a lack of methodological innovation. What matters is how these techniques address a previously unresolved transfer problem. To our knowledge, PhoenixSR is the first framework to use DMD to transfer pretrained diffusion priors to independently designed non-diffusion SR students that inherit neither the diffusion teacher's denoising architecture nor its pretrained weights, while preserving the students' original inference architectures. It is also effective on SeeMoRe with only 0.97M parameters and SwinIR-S with 1.05M parameters, requiring distributional priors to translate into actual reconstruction capabilities within the students' limited capacity and original inference costs.
These components act at different stages of distributional supervision. DMD constrains the overall output distribution, but distributional proximity does not automatically determine whether each output corresponds to its own LR input. SFA therefore maintains input correspondence through pixel and paired perceptual supervision, and supplements texture realism with an adversarial term. Real-score LoRA addresses the difference between generic diffusion priors and the HR target domain. The fake-score model is fully updated online to track the continuously changing student distribution, while REPA constrains the representations of this online estimator. The representation constraint is applied to the fake-score model that provides supervision, and the original SR student retains its own reconstruction structure.
Timestep truncation and DRW further regulate how distributional guidance is used. The former selects noise states that still retain more image structure, while the latter adjusts each sample's contribution to supervision according to the directional consistency of denoising residuals near the generated image and its paired HR image. Paired constraints preserve the content to be restored, score adaptation improves distributional supervision, and noise scheduling and sample weighting regulate how supervision is applied.
Table 5 of the paper has already conducted the above ablations under the same setting:
Paired supervision provides a fidelity constraint for distributional transfer. Adding distributional supervision and score adaptation substantially improves MUSIQ. Further adding DRW improves both PSNR and MUSIQ. Table 11 also separately examines fake-score REPA and real-score LoRA, with the two adaptations increasing PSNR from 25.9778 to 26.4409 dB. Table 12 shows that removing timestep truncation reduces PSNR to 25.6564 dB. This evidence corresponds to the roles of input fidelity, score estimation, and guidance conditions, respectively. The contribution of this paper is to establish and validate this distributional transfer method for independent non-diffusion students, enabling existing SR students, including networks with several million to over ten million parameters, to use diffusion priors.