- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies the image reconstruction of spike cameras and proposes LTGF, which utilizes a feature enhanced basic regression network with generative restoration branches. The model constructs TFP images based on the frequency of issuance and TFI images based on the spike interval from the same spike sequence, serving as two starting points for the shared and spike conditional flow matching network. Each source infers candidate images and multi-scale features through a single step calculation. The experiment covers synthetic spike data derived from REDS and six real scenes, reporting reconstruction quality, computational complexity, ablation, as well as uncertainty and candidate error relationships on the test set.
Critical strengths
-
Obtained a valuable compromise between reconstruction quality and computational cost. In Table 1, the PSNR of LTGF is 43.4765 dB, which is 0.2891 dB higher than the strongest listed baseline Spike ODE. SSIM and LPIPS also improve simultaneously. According to the report in Table 5, the number of parameters and FLOPs decreased by approximately 46.4% and 83.7%, respectively. This result of improving reconstruction quality while reducing computational costs has practical significance for high temporal resolution imaging tasks.
-
The verification of 'uncertainty assisted selection' is relatively complete. The attention fusion comparison in Table 4 retains the same base extractor, two candidate sources, residual correction, and decoder, making it more explanatory than simply removing the entire branch. The complete method improved the control by approximately 0.2914 dB and reduced the LPIPS from 0.0384 to 0.0299. Appendix F further validated the relationship between prediction uncertainty and candidate error on all 80 synthetic test samples and 20 scenes, and provided scenes clustering bootstrap intervals. These pieces of evidence collectively support using the prediction error scale as a fusion cue.
Critical weaknesses
W1. The contribution of flow matching training itself has not been isolated yet. According to equations (6) and (8), at the t=0 endpoint used for fusion in practice, velocity supervision is equivalent to mean square error supervision of candidate images. The existing results cannot clearly distinguish the benefits brought by random flow time training from those brought by additional auxiliary recovery networks, TFP/TFI inputs, and joint supervision. Table 3 validates the role of candidate sources, while Table 4 validates the fusion strategy, but lacks a control that maintains consistency between the network and fusion structure and only uses endpoint residual regression training. This affects the assessment of the core contribution of 'generative features'.
W2. The relative PSNR gain of SpikeODE and attention fusion is about 0.29 dB. The bootstrap analysis in Appendix F focuses on the relationship between uncertainty and candidate errors, but has not yet covered the differences in final reconstruction performance. The average advantage of real data is also relatively small and dependent on the scenes: for example, the average gain of MUSIQ is 0.1000, where the gain of Car is 0.7350, and the average difference of the other five scenes is about -0.0270. The existing results support the average improvement on the evaluated data, but more caution is still needed in assessing the stability of the advantages across different scenes.
Questions for authors
Q1. Can you retain the same shared U-Net, TFP/TFI starting point, uncertainty header, and fusion module, remove only random training with t > 0, and use residual regression supervision with t = 0?
Q2. Does the feature attention fusion in Table 4 retain the uncertainty header and the same auxiliary supervision, only removing the term from the fusion logit? If these supervisions are also removed, the current differences will include both the effects of auxiliary training and fusion rules.
Q3. Does the 800/80/80 data partitioning ensure that the original REDS video or scene is mutually exclusive? Should each learning baseline use public weights or retrain on the same partition?
Q4. Can you provide a scene-based paired bootstrap interval for the PSNR and LPIPS differences between the complete model and SpikeODE/attention fusion?