- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
CT-Net processes timestamped events with a time-gap-conditioned state-space encoder before mapping them onto a spatial grid, then fuses them with DINOv2 image features. The full system reports a substantial 4.33-point mIoU improvement over the published MambaSeg result on DSEC-Semantic. Yet the DDD17 improvement is only 0.78 points, with slightly lower pixel accuracy. More importantly, the only matched frozen-backbone DSEC comparison gives 76.48 mIoU for the voxel-free branch versus 76.50 for voxelization. The headline result therefore does not establish that continuous-time, voxel-free processing—rather than the stronger image backbone and other changes—produces the gain. The wording about selecting the “best-epoch test” result also requires clarification.
Critical strengths
- A clear temporal modeling hypothesis. Using measured inter-event gaps before spatial aggregation is a technically relevant idea for asynchronous event data. If its benefit is isolated, it could be more consequential than another fusion-module adjustment.
- Promising complete-system DSEC result. The reported 79.43 versus 75.10 mIoU is a sizable improvement worth investigating, although the present comparison does not establish which component produces it.
Critical weaknesses
- Define the new mechanism precisely. The distinctive step appears to be conditioning the state-space update on inter-event time gaps; the image backbone and parts of the fusion design build on existing components. Please state the exact technical difference from prior temporal event encoders and explain why that difference should improve segmentation.
- Directly test the voxel-free contribution. The matched frozen-backbone DSEC comparison is effectively tied, with voxel-free processing 0.02 mIoU points lower. Table 3 then changes both backbone fine-tuning and the event representation between key rows, so its larger gain cannot be attributed to either one. Please test voxelized versus continuous-time input with both frozen and fine-tuned backbones on both datasets, and ablate the time-gap term itself.
- Make the headline baseline comparison fair. The principal MambaSeg value is quoted from its publication, while CT-Net uses a large DINOv2 image encoder. Even the frozen-DINO voxel baseline exceeds that published DSEC value by 1.40 mIoU points. Please disclose the exact checkpoint and pretraining, and provide a matched-backbone or otherwise carefully qualified comparison before assigning the 4.33-point gain to the proposed event method.
- Establish whether the smaller gains are reliable. The joint fusion addition yields 0.64 and 0.65 mIoU points on the two datasets; the full-model DDD17 advantage is 0.78 points while pixel accuracy decreases by 0.07 points. Please report repeated-run variation, isolate the fusion components, and show per-class or difficult-condition results. These positive mIoU differences should not be treated as decisive without evidence that they exceed variation or deliver a meaningful practical benefit.
And the following two comments are very important for authors and need to be addressed before the next submission.
- The ablations do not establish the contribution of each component. Table 3 changes both DINOv2 fine-tuning and the event representation between key rows, so their effects cannot be separated. The matched frozen-backbone comparison gives 76.48 mIoU for voxel-free processing versus 76.50 for voxelization on DSEC-Semantic, while CMGA and SFF are evaluated only together, adding 0.64 and 0.65 points on the two datasets. Please evaluate CT-EvSSM against a matched voxel baseline, ablate its inter-event-time term, and report CMGA-only, SFF-only, and combined variants under the same training settings.
- The architecture figure does not adequately explain the proposed modules. Figure 1 shows CT-EvSSM and the fusion pathways largely as high-level boxes, making it difficult to trace how timestamped events are processed, scattered into spatial features, aligned by CMGA, and fused by SFF. Please expand or redraw the figure with module-level diagrams, feature dimensions, and the inputs and outputs of each stage. In particular, clarify how the temporal pathway operates after event features have been scattered onto a 2D grid.
Questions for authors
- Which split was used to select the reported epoch and tune hyperparameters? Does “best-epoch test” mean that test results influenced selection?
- Which exact DINOv2 checkpoint and pretraining were used, and are repeated-run results available for the smaller DDD17 and fusion-module gains?