- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
This paper proposes Graphene, a lightweight Transformer for image super-resolution with two feature refinement modules: Ising Refinement Block (IRB) and History Attention (HistAttn). IRB uses pre-softmax attention logits to construct signed pairwise interactions and applies mean-field updates to control local residual refinement. HistAttn adaptively aggregates features from different network stages. Experiments show that Graphene achieves competitive reconstruction quality with reduced computational costs.
Critical strengths
- IRB derives signed local interactions from attention logits and leverages mean-field updates to gate residual corrections, refining fine local structures coordinately.
- HistAttn adaptively reuses representations across stages at each token position, aggregating cross-depth features without additional spatial pairwise attention.
- The paper compares different IRB configurations and evaluates adaptive history selection against static weighting and simple skip connections.
Critical weaknesses
1.The motivation for the IRB module is insufficiently explained, and the principles of the method are not clearly stated. 2. Some ablation experiments showed only minor improvements. Compared to using only binary gates, the full IRB model increased PSNR by only 0.04 dB, while HistAttn increased PSNR by only 0.03 dB compared to static historical weights. 3. The argument regarding complementarity is not sufficiently substantiated. Although the combined model achieved the highest PSNR, its performance was only 0.05 dB better than that of IRB used alone. The results indicate that the modules can be used in combination but do not demonstrate strong synergistic effects. 4. The efficiency claims require further substantiation. In the reported component ablation experiments, IRB added approximately 2.4M parameters and 20.4G FLOPs. Furthermore, its reliance on numerical values for pre-softened maximum attention may limit its compatibility with optimized attention implementation schemes.
Questions for authors
- Why is Ising mean-field refinement necessary for local feature refinement? Can simpler input-dependent gating or local interaction mechanisms achieve comparable results?
- How do the authors distinguish functional complementarity from actual performance synergy? Can they provide stronger evidence that HistAttn consistently improves performance when IRB is already enabled?
- Could the author provide a more comprehensive comparison with the latest image super-resolution methods published over the past two years? In particular, a comparison with recent Transformer-based and lightweight super-resolution methods would help illustrate Graphene’s advantages in terms of reconstruction quality, computational efficiency, and methodological innovation.
3 comments
Thank you for the response. After reviewing the additional experimental results and the comments from other reviewers, the authors address some of my concerns; however, I still have questions regarding the motivation and principles behind this method, and the performance gains resulting from the core operations are limited. Therefore, I retain my original rating.
Graphene breaks the rule that higher PSNR must be bought with higher cost
Thank you for your review. If a specific point remains unclear, please tell us which one, and we will answer it directly.
Given the experience behind your confidence rating, you will recognize that Graphene moves the accuracy–cost Pareto frontier forward. If there is anything you would like to know more about, please let us know; we are confident that we can answer even the subtle points.
No simpler mechanism matches IRB, at lower cost than recent methods
W1 / Q1. Motivation and principle of IRB; can simpler mechanisms compete? As requested, Section 3.2 now opens with a Motivation paragraph. No simpler mechanism we tested matches IRB.
W2. Small increments (IRB vs. unary gate; HistAttn vs. static weights). These numbers compare single design choices at near-identical cost; the module contributions are much larger.
W3 / Q2. Complementarity versus synergy. We claim complementarity, not super-additive synergy. IRB acts within a window at one depth; HistAttn acts across depth at one token position. Each helps when the other is present:
W4. IRB cost and compatibility with optimized attention. As requested, every method is now measured in two settings (BF16 compiled: Section 4.1, Figure 1, Tables 3–4; FP32 eager: Appendix E.3, Figure 8, Tables 15–16). In both, Graphene stays on the accuracy–cost Pareto front at every input size.
Q3. Comparison with recent methods. Table 3 and Appendix E (full comparison: Tables 13–14) already include the latest models: IPG and ATD (CVPR 2024), MambaIR (ECCV 2024), MambaIRv2 and PFT (CVPR 2025), IET (ECCV 2026) and UCAN (CVPR 2026), and the lightweight versions of ATD, MambaIR, MambaIRv2, PFT and IET.