- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
SAFA uses the singular values of pretrained UNet weights to select LoRA modules and adjust their ranks before training for image super-resolution.
Critical strengths
This paper introduces Spectral-Aware Fidelity Adaptation (SAFA) to estimate effective LoRA ranks for different modules, reducing LoRA parameters from 8.11M to 1.32M while achieving competitive PSNR and SSIM performance.
Critical weaknesses
(1) The main idea provides limited novelty. Similar non-uniform rank allocation strategies have already been studied in methods such as AdaLoRA. SAFA mainly replaces the training-time importance estimation with a fixed statistic derived from pretrained weights. Furthermore, the practical benefit of LoRA parameter reduction is unclear. The experiments are only conducted on UNet-based Stable Diffusion backbones, where the LoRA parameters are already very small (1.32M compared to 866M parameters in SD 2.1). Therefore, reducing LoRA parameters from 8.11M to 1.32M may have limited impact on training speed, memory usage, or inference efficiency. The effectiveness of such aggressive LoRA compression seems unclear.
(2) The ablation studies in Tab. 2 and 3 do not include no-reference metrics. Only reporting PSNR and LPIPS is insufficient to demonstrate the effectiveness of the proposed method for diffusion-based image super-resolution. Meanwhile, SAFA achieves almost the worst CLIPIQA and MUSIQ scores across all benchmarks, indicating that the proposed rank allocation strategy may have difficulty preserving perceptual quality.
Questions for authors
(1) What values of r_min and r_max are used in Eq. (3)? How does the performance change when directly increasing or decreasing the LoRA ranks of all modules?
(2) Are the illustrations in Fig. 2 AI-generated? Some details appear distorted, and several components are not well aligned, especially in the UNet architecture. Please clarify how this figure is generated and whether it accurately represents the actual model architecture.