- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper addresses a relevant problem and reports encouraging results. However, the technical contribution seems somewhat incremental, and the evidence for the physics-inspired design is not fully convincing. In particular, it is not clearly shown why wave-based fusion is better than simpler spectral alternatives. The experimental comparisons and robustness analysis also leave important questions unanswered.
Still, I recognize the potential value of this work for event-based vision. I am open to raising my score if the authors can adequately address the above concerns, especially with stronger evidence for the physical motivation, more controlled comparisons, and additional robustness experiments.
Critical strengths
Low-light Event–RGB semantic segmentation is a meaningful problem, and combining the two modalities is reasonable because their information is complementary.
The WFTF module has a clear mathematical formulation. Using the analytical solution of a damped wave equation in the Fourier domain is an interesting design choice.
The method unifies frequency filtering and cross-modal coupling, which offers an alternative to common attention-based and spatial fusion methods.
Experiments cover four benchmarks and show consistent improvements, with large gains under extreme degradation. The paper also provides ablations and computational cost analysis, and the model reports fewer parameters and FLOPs than MambaSeg.
Critical weaknesses
Technical novelty seems limited. The framework follows a common dual-branch architecture with pretrained encoders and multi-scale fusion. The main contribution, WFTF, combines existing ideas from Fourier filtering, wave propagation, and cross-modal interaction. It is not clear whether it gives a fundamental advantage over simpler frequency-domain fusion methods.
The physical motivation is not sufficiently supported, I am afraid. The method assumes event features mainly provide high-frequency information and RGB features provide reliable low-frequency information. However, event cameras measure temporal brightness changes, which do not necessarily correspond to high spatial frequencies. The paper gives no detailed frequency analysis of real RGB and event features, and the learned wave parameters and coupling weights are not visualized. Thus, it is unclear whether the module learns the expected physical behavior.
The ablation study is insufficient to justify the design. Table 3 shows that removing WFTF components reduces performance, but their individual contributions are not fully isolated. For example, removing the propagator still leaves the Fourier filter and cross-modal coupling active. The paper also lacks controlled comparisons with standard learnable Fourier operators under the same parameter budget. The 0.64 mIoU gain over the DCT-based wave gating baseline is relatively small, and no statistical analysis is given.
Experimental comparisons are not sufficiently controlled. MambaFourier and MambaSeg use different backbones and fusion architectures, so the improvements cannot be fully attributed to WFTF. Table 1 mainly uses results reported by ESC, while the proposed model is trained separately. The paper should clarify whether training settings, pretrained weights, and computational budgets are comparable. Multiple random seeds are also needed.
Robustness and generalization claims need stronger evidence. Most challenging conditions are synthetic. In the additional rain, fog, and dark-night experiments, the event stream remains unchanged, which does not fully reflect real event sensor behavior under low illumination and noise. The self-collected dataset reports only the proposed method without baseline comparisons, and cross-resolution transfer is not directly evaluated.
Questions for authors
Why is the physics-based wave propagator necessary? Could the authors compare WFTF with simpler Fourier filtering and spectral fusion modules under exactly the same backbone, training settings, and parameter budget? Visualizing the learned spectral responses and coupling weights would also help show whether they follow the proposed physical interpretation.
How well does the method generalize to real low-light conditions, especially when the event stream contains realistic noise, missing events, or reduced activity? Could the authors also provide baseline comparisons on the self-collected dataset?
We thank the reviewer for recognizing the importance of low-light event–RGB segmentation and the potential of WFTF. We have expanded the evidence with multiple spectral alternatives, supplementary coupling experiments, and repeated WFTF training runs.
1. Technical contribution and physical motivation
The contribution is the WFTF fusion operator. The dual-branch framework and GroupMamba encoders provide its host architecture. WFTF combines:
The wave parameterization supplies a compact family of frequency-dependent attenuation and oscillatory responses. Its role is to provide a structured inductive bias for representation learning. The exact solution applies to the propagator; the subsequent filtering and coupling provide learned flexibility. This defines the mathematical contribution without requiring encoder features to obey a literal physical wave law.
2. Additional comparisons with simpler spectral alternatives
We implemented and trained DCT, asymmetric DCT, Fourier, and Gaussian controls on DERS-XS, sharing the dual GroupMamba-Small encoders, pretrained weights, decoder, sample splits, and augmentation.
The matched 200-epoch comparison shows comparable accuracy with approximately 1.08M fewer fusion parameters for WFTF. This supports the parameter efficiency of its structured design. The other controls are reference results under their stated 100-epoch schedules.
Across WFTF seeds 0/1/2, best validation scores within the common first 177 epochs of the planned 200-epoch schedule are 70.27/69.47/69.72, yielding 69.82±0.41 mIoU (sample SD). Seed 2 currently reaches epoch 177. Separate Test evaluations for seeds 0/1 yield 68.25/68.62. This quantifies WFTF variability and is distinct from a paired significance test against SWP.
3. Component contributions and controlled attribution
The shared-architecture DDD17 study gives:
These interventions address whether each component improves the complete architecture while the others are retained. All three contribute positively under this protocol. Their interpretation is conditional component utility, rather than independent or additive effects.
Additional DDD17 logs record 78.8266 for symmetric DCT, 78.8496 for unconstrained DCT, and 79.0150 for kappa-zero. These are supplementary single-seed best evaluation results using ten event bins and LR 3×10−4, reported separately from the manuscript recipe.
We distinguish the comparison levels: Table 1 and the MambaSeg comparison evaluate complete systems, whereas shared-backbone studies assess fusion choices within a common architecture. This avoids attributing backbone or training differences exclusively to WFTF.
4. Spectral interpretation
We clarify that temporal contrast and spatial frequency are different quantities. The motivation is feature-dependent spectral complementarity, rather than an assumption that events contain only high spatial frequencies.
DSEC coupling support expands from 5.7% at stage 1 to 100% at stage 4, enabling selective exchange across multiple representation scales. These percentages describe architectural support. Learned spectral maps and band interventions would quantify a trained model’s actual frequency preferences and their causal contributions; support coverage alone is not such a measurement.
5. Robustness, real data, and resolution
The evaluation covers complementary conditions: RGB-only rain/fog corruption, joint frame/event degradation in DSEC-Xtrm, and low-light frames with noisy synthetic events in DERS-XS.
Under corruption-aware rain/fog training, MambaFourier achieves 73.7 mIoU, compared with 72.5 for MambaSeg and 71.5 for EISNet. DSEC-Xtrm and DERS-XS extend the evaluation to settings with degraded event information.
The campus dataset supplies additional real-data evidence: 68.1 mIoU and 95.95% pixel accuracy after training on its designated split. We present this as additional real-data evaluation, rather than a comparative campus ranking or zero-shot transfer result.
Mode-indexed parameters also permit operation at different feature-map sizes. This architectural property is distinguished from measured cross-resolution transfer accuracy. Our robustness conclusions correspond to the evaluated protocols, including synthetic event noise, rather than extrapolation to all real-sensor noise, missing-event, or reduced-activity conditions.