- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a multi-branch implicit neural representation method based on singular spectrum analysis (SSA), aimed at improving image representation performance by explicitly assigning learning tasks to different branches. The authors first decompose an image into four components—structure, horizontal details, vertical details, and joint details—then use four SIREN networks to fit each component separately, and finally combine the outputs of each branch to reconstruct the original image. Additionally, the authors introduce strategies such as a gating mechanism, branch pretraining, and PSO initialization to optimize training, and evaluate the method’s performance on the Kodak dataset.
Critical strengths
The research motivation behind this paper is quite clear: addressing the challenge of naturally achieving effective task division in multi-branch networks, it utilizes SSA to provide explicit supervision objectives for different branches, enabling each branch to learn distinct signal components. This design offers a certain degree of intuitiveness and interpretability. Furthermore, the authors combine SSA decomposition, gating mechanisms, coordinate scaling, and joint optimization. By analyzing the performance of the method from multiple perspectives—including branch alignment, spectral analysis, and ablation experiments—they provide a basis for understanding the roles of each branch and leave room for exploring the application of this approach in other signal representation tasks.
Critical weaknesses
- Inconsistent training budgets and attribution issues The full method includes 500 rounds of independent pre-training, 500 rounds of joint training, and PSO search for each branch; the baseline only matches the computational effort of the joint training. The performance differences are confounded by the effects of pre-training, search initialization, supervision schemes, and computational overhead, making it impossible to attribute them solely to the benefits derived from branch division.
- Comparison of decomposition methods: Numerical values conflict with textual conclusions This is further substantiated in Table 5 and shows for the highest PSNR value (SSA) 48.61 dB, followed by the values for FFT and DWT of 48.29 dB and 48.31 dB, However, this contradicts the descriptions in the main text and Appendix A.8. Authors should use consistent benchmarks and experimental setups to ensure that the values and differences in the tables, as well as the conclusions in the main text, are consistent.
Questions for authors
After balancing the number of parameters with the total optimization budget and accounting for pretraining and PSO costs, how much of an advantage does the complete method retain over the unguided baseline? Which SSA result in Table 5 should be used as a reference? Which images and how many runs do the ablation experiments in Table 2 correspond to? Under the condition of retaining branch-assisted supervision but not assigning different spectral roles, can the additional benefits of SSA task division still be observed? Compared to existing decomposition-based supervision methods such as MINER, what is the most significant new contribution of this paper, and which experiments directly support this claim?
10 comments
[W] Comparison of decomposition methods: Numerical values conflict with textual conclusions This is further substantiated in Table 5 and shows for the highest PSNR value (SSA) 48.61 dB, followed by the values for FFT and DWT of 48.29 dB and 48.31 dB, However, this contradicts the descriptions in the main text and Appendix A.8. Authors should use consistent benchmarks and experimental setups to ensure that the values and differences in the tables, as well as the conclusions in the main text, are consistent.
[A] We would like to thank the reviewer for pointing this out. The absolute PSNR values in the original Table 5 placed SSA first on kodim20.png. The FFT and Haar DWT differences were computed against an incorrect SSA reference, which led to the conflicting interpretation in the text.
The revised comparison in Table 7 covers all 24 Kodak images. Each decomposition was fitted once per image at seed 42 using the same four-branch INR architecture and training schedule, including PSO scale initialisation, 500 epochs of branch pretraining, and 500 epochs of joint optimisation.
Table 7 uses SSA’s mean best-checkpoint full-image PSNR of 48.41 dB as the reference for PSNR. FFT, Haar DWT, and KLT were 0.31 dB, 0.34 dB, and 1.12 dB lower, respectively. Section 4.5 and Appendix A.8 now report these same differences and state that SSA achieved the highest mean PSNR among the four configurations evaluated on Kodak-24.
[Q] After balancing the number of parameters with the total optimization budget and accounting for pretraining and PSO costs, how much of an advantage does the complete method retain over the unguided baseline?
[A] We thank the reviewer for this question.
We added a matched-time comparison across all 24 Kodak images at seed 42 (section 4.4 and Appendix A.7, Table 6). The unguided control matched the proposed model in branch count, width, depth, and fusion. It used fixed unit coordinate scales and had 533,520 trainable parameters, compared with 533,528 for the complete method. The eight additional parameters are the learnable coordinate scales.
For each image, the unguided control received the complete method’s measured end-to-end fitting time, including uncached SSA target construction, PSO scale initialisation, branch pretraining, and joint optimisation with checkpoint evaluation. The mean fitting times were 911.27 s for the complete method and 911.19 s for the unguided control. The largest per-image difference was 0.57 s.
Under these matched budgets, the complete method achieved a mean best-checkpoint PSNR of 48.31 dB versus 46.36 dB for the unguided control. It retained a mean paired advantage of 1.95 dB and achieved higher PSNR on all 24 images.
[W] Inconsistent training budgets and attribution issues The full method includes 500 rounds of independent pre-training, 500 rounds of joint training, and PSO search for each branch; the baseline only matches the computational effort of the joint training. The performance differences are confounded by the effects of pre-training, search initialization, supervision schemes, and computational overhead, making it impossible to attribute them solely to the benefits derived from branch division.
[A] Thank you for raising this concern. It prompted us to make the training comparison fairer by accounting for the full fitting cost and to state more precisely what the ablation shows about the contribution of SSA supervision.
We compared the proposed method with an architecturally matched unguided four-branch INR under matched per-image fitting times on Kodak-24 (Table 6, Appendix A.7). The budget for the proposed method includes SSA target construction, PSO initialisation, branch pretraining, and joint training. Both methods averaged approximately 911 s per image. The proposed method achieved a mean PSNR of 48.31 dB compared with 46.36 dB for the unguided control, a gain of 1.95 dB, with higher PSNR on all 24 images.
In the cumulative ablation (Table 2), adding branch-specific SSA supervision during joint training increased PSNR from 45.50 to 47.01 dB on kodim20.png before branch pretraining and PSO were introduced. This result supports a contribution from SSA supervision. The matched-time gain measures the performance of the complete method.
We also reran the external baselines and the unguided parallel network for 1,000 epochs. The proposed method retained its PSNR advantage in these runs, and we will report the updated comparison in Figure 4.