- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes FreqDiSR, a spectral-guided capacity allocation framework for one-step diffusion-based image super-resolution. Building upon a dual-branch LoRA architecture, the method uses high-frequency energy statistics extracted from a frozen U-Net to allocate complementary ranks between pixel-oriented and semantic-oriented branches under a fixed capacity budget. The framework further incorporates wavelet-based high-frequency modulation and a low-frequency structural constraint. Experiments on super-resolution benchmarks report improvements in reconstruction and perceptual quality, supported by component ablations, alternative allocation strategies, and statistical analyses.
Critical strengths
1.Rather than simply increasing adaptation capacity, the paper considers how a limited LoRA budget should be distributed between branches with different restoration objectives. This is a meaningful problem for parameter-efficient adaptation of diffusion-based super-resolution models.
2.The proposed framework achieves improvements over the underlying dual-branch baseline, and the authors include several controlled allocation strategies, including inverse, depth-based, and shuffled assignments. These experiments provide preliminary evidence that the allocation pattern matters, although they do not fully establish the necessity of the proposed spectral criterion.
Critical weaknesses
- The contribution of spectral-guided capacity allocation is not convincingly isolated from the other components of the framework.
The paper attributes its performance improvements to spectral-guided capacity allocation, but the overall framework simultaneously introduces multiple modifications, including frequency-based rank assignment, wavelet modulation, and additional structural supervision. Although component ablations and alternative allocation strategies are provided, the evidence does not fully establish how much of the improvement can be attributed specifically to the proposed spectral allocation mechanism.
In particular, the comparison against uniform rank allocation is not strictly controlled, as it also changes the rank configuration of modules outside the spectral allocation scheme. This leaves an important confounding factor in what should be the most direct baseline for evaluating the central contribution. Moreover, the improvements associated with the allocation strategy are relatively modest, and the relevant controlled experiments do not adequately account for training variability.
Consequently, while the complete framework appears effective, the current results do not convincingly establish that spectral-guided allocation itself provides a substantial and reproducible advantage over simpler capacity allocation strategies.
- The central assumption linking spectral characteristics to branch-specific capacity requirements remains insufficiently justified.
The proposed method relies on the assumption that the high-frequency energy of frozen U-Net features provides a meaningful indication of how adaptation capacity should be distributed between pixel-oriented and semantic-oriented branches. However, feature frequency statistics and the actual marginal benefit of allocating additional LoRA capacity are fundamentally different quantities.
The paper demonstrates that the spectral measurements are relatively stable and that certain alternative allocation patterns perform worse. Nevertheless, these observations do not directly establish that the proposed spectral criterion captures the underlying capacity requirements of the two branches. It remains unclear whether the observed benefits arise from a meaningful relationship between spectral characteristics and adaptation needs, or from a particular allocation heuristic that happens to work under the evaluated configuration.
This concern is particularly important because the proposed allocation rule constitutes the primary methodological novelty of the paper. Without stronger evidence connecting the spectral measurements to actual adaptation benefits, the method remains insufficiently motivated beyond its empirical performance on the reported setup.
Questions for authors
-
Can the authors demonstrate that spectral-guided rank allocation provides a substantial and reproducible advantage over a strictly controlled uniform allocation baseline? In particular, could the authors compare against uniform allocation while keeping all modules outside the proposed spectral allocation scheme unchanged, under identical parameter budgets and training conditions? Given the relatively modest gains in the allocation-specific ablations, evidence across multiple training seeds would be important for establishing the robustness of the claimed contribution.
-
What evidence supports the assumption that high-frequency feature energy is a meaningful indicator of branch-specific adaptation capacity requirements? The current analysis primarily establishes the stability of spectral statistics rather than their relationship to the actual benefits of allocating additional capacity. Could the authors provide direct evidence that the proposed spectral measurements predict the relative effectiveness of allocating capacity to the pixel and semantic branches, rather than merely correlating with layer characteristics or architectural structure?
-
To what extent does the proposed spectral allocation rule generalize beyond the specific architecture and capacity configuration considered in the paper? Since the allocation mechanism is presented as the main methodological contribution, it would be important to establish whether its advantages persist under different capacity budgets or model configurations, rather than being specific to the evaluated setup.