- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies RL post-training of diffusion-based real-world super-resolution models, seeking to improve perceptual detail without losing structural fidelity. It proposes NA-DePO, which combines an approximate range/null-space decomposition with local VLM-derived rewards, sigmoid reward reweighting, and timestep-dependent reward scheduling. The method is evaluated on DIV2K and RealLQ using M3ESR as backbone, with ablations and qualitative comparisons.
Critical strengths
1: A coherent fidelity-preserving RL formulation. Section 3.4 and Equations 8 to 12 provide a concrete way to combine preference optimization with a low-frequency observation constraint. Table 2 supports the basic motivation: unconstrained RL improves some no-reference scores but substantially harms PSNR and LPIPS relative to the proposed full method, while the complete method improves both perceptual metrics and LPIPS over M3ESR.
2: Consistent empirical improvements over the chosen backbone. Table 1 reports that M3ESR + Ours achieves the strongest listed no-reference perceptual scores on both DIV2K and RealLQ, while Figure 6 and Table 2 provide evidence of an improved fidelity-perceptuality trade-off relative to the pretrained backbone. The direct re-training of DPPO-SR and LucidNFT on the same M3ESR backbone is particularly valuable for making the RL comparison more meaningful.
Critical weaknesses
-
The paper’s central “null-space anchored” interpretation is only heuristic in the actual implementation, but the main claims often describe it as a strict exploration restriction. Section 3.4 introduces Equation 7 using a pseudo-inverse and argues that RL is projected into the null-space while the range-space is preserved. Yet the implementation discussion on Pages 17 to 18 states that is interpolation rather than the Moore–Penrose pseudo-inverse, so is only an approximate projection. Consequently, is not generally a null-space component of the actual observation operator, and because the VAE decoder is nonlinear, the latent operation does not imply a corresponding observation-preserving decomposition in image space. The appendix appropriately acknowledges this limitation, but this substantially weakens language in the abstract, Section 3.4, and conclusion suggesting that RL exploration is restricted “exclusively” to an unconstrained null-space or that it ensures signal constancy. The method may still be a useful frequency-biased anchoring heuristic, but the claim should be narrowed accordingly. A resolution would be to clearly distinguish the practical approximate projection from a mathematical null-space constraint throughout the paper, and quantify LR-consistency directly, for example by reporting or an equivalent observation-domain residual against relevant variants.
-
The evidence does not isolate the two advertised dense-guidance contributions, namely spatial reward factorization and QwenVL-Local. Section 3.3 claims that QwenVL-Local yields precise local semantic supervision, and Sections 3.3 and 3.6 claim that spatialized rewards and scheduling reduce reward conflicts and stabilize training. However, Table 2 contains no “without QwenVL-Local,” global-Qwen, or scalar-reward counterpart under otherwise identical null-space anchoring, reward composition, and sigmoid mapping. Figure 12 is qualitative only, while the scalar DiffusionNFT row in Table 2 changes multiple factors at once. Likewise, the “w/o reward scheduling” ablation changes the schedule but does not establish that spatial factorization itself is beneficial, and no metric of multi-reward conflict or gradient disagreement is provided. Since dense VLM guidance is a central contribution rather than an implementation detail, controlled quantitative ablations are necessary to establish the claimed causal mechanism. At minimum, the authors should report a matched scalar version of the same rewards, a global-Qwen similarity version, and metrics for the Qwen-removal variant; otherwise the corresponding claims should be softened.
-
The experimental positioning omits directly relevant recent RL-for-RealSR approaches, making the state-of-the-art and novelty claims insufficiently established. Table 1 compares DPPO-SR and LucidNFT, but the paper does not discuss or evaluate process-aware and VLM-guided RL alternatives that also explicitly address the realism-fidelity trade-off. This matters because the claimed contribution is not merely applying RL to SR, but specifically improving reward guidance and constraining exploration. A direct comparison or a careful discussion of the methodological distinctions from OARS and RealSR-R1 is needed; if comparable implementations are available, evaluation on the same MSE3R protocol would be the most informative resolution.
Potentially Missing Related Work
Zhao et al., OARS: Process-Aware Online Alignment for Generative Real-World Image Super-Resolution, 2026 — directly studies online RL alignment for generative RealSR with staged/process-aware reward design and fidelity-perception considerations. It should be discussed in Section 2.2 and compared conceptually with the proposed timestep-dependent reward scheduling and constrained exploration; it is also a strong relevant baseline for Table 1.
Qiao et al., RealSR-R1: Reinforcement Learning for Real-World Image Super-Resolution with Vision-Language Chain-of-Thought, 2025 — directly applies RL with multiple vision-language-based reward signals to RealSR. It should be discussed in Sections 1 and 2.2, especially relative to the paper’s claim that VLM-guided dense rewards provide a new route to semantic consistency.
Wu et al., One-Step Effective Diffusion Network for Real-World Image Super-Resolution, 2024 — introduces OSEDiff, a relevant generative RealSR baseline with a different diffusion parameterization and supervision strategy. It should be added to the diffusion-based RealSR discussion in Section 2.1 and considered in the quantitative comparison when compatible evaluation results are available.
Wei et al., Perceive, Understand and Restore: Real-World Image Super-Resolution with Autoregressive Multimodal Generative Models, 2025 — studies semantic understanding and multimodal generative priors for RealSR, directly relevant to the semantic-consistency framing of QwenVL-Local. It should be cited in Section 2.1’s discussion of high-level and multimodal guidance.
Hu et al., Text-Aware Real-World Image Super-Resolution via Diffusion Model with Joint Segmentation Decoders, 2025 — addresses structure preservation under semantic constraints in RealSR. It should be discussed in Section 2.1 as related work on improving fidelity-perceptual quality under explicit semantic guidance.
Questions for authors
- In the actual latent-space implementation of Equations 8 to 12, what quantitative LR-observation consistency is achieved, for example after decoding, compared with M3ESR + DiffusionNFT and the “w/o Range Constraint” variant? Evidence that the proposed projection reduces observation residual would increase my confidence in the anchoring interpretation.
2.Can the authors provide quantitative results for a matched ablation that removes QwenVL-Local, and for a version replacing its patchwise map with a global Qwen embedding similarity? If the patchwise version consistently improves semantic and perceptual metrics under otherwise fixed training, it would resolve a central attribution concern.
3.Does the “w/o reward scheduling” result in Table 2 use exactly the same per-reward normalization, spatial maps, and aggregate reward weights as the full method, with only time assignment changed? Please clarify this, since the answer determines whether the ablation isolates scheduling.
- Could the method be extended to use an estimated or learned observation operator for real degradations, rather than fixed average pooling? This would test whether the anchoring mechanism remains effective when the LR formation process differs materially from the synthetic training degradation.