- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Temporal Focusing Convolution (TFoC) for radar semantic segmentation. The method introduces Semantic Alignment-based Focusing (SAF) to identify relevant features from historical radar frames and Trajectory Consistency-based Aggregation (TCA) to incorporate temporal information. An auxiliary Track Loss is proposed to encourage temporal consistency. The authors evaluate the approach on CARRADA, CARRADA-RAC, and KuRALS datasets.
Critical strengths
- The paper presents an interesting approach to temporal feature aggregation for radar semantic segmentation. Rather than aggregating information from fixed spatial locations across frames, TFoC learns to focus on relevant historical features. This is particularly meaningful for radar data, where moving targets may occupy different locations across consecutive frames.
- The experimental evaluation covers different radar technologies and application scenarios, which is a notable strength. The authors evaluate TFoC on automotive FMCW radar data (CARRADA and CARRADA-RAC) and Ku-band surveillance radar data (KuRALS-CW and KuRALS-PD). The results in Tables 2 and 3 are promising, with state-of-the-art performance on CARRADA-RAC and substantial improvements on KuRALS-PD. This demonstrates the applicability of the proposed approach across different radar sensing systems.
- The authors provide useful analyses of the proposed focusing mechanism and its sensitivity to temporal continuity. Table 1 compares different spatial focusing strategies, while Figure 4 evaluates the contribution of Track Loss. Appendix D.1 further investigates temporal continuity across datasets and helps explain the differences in performance.
Critical weaknesses
-
Although the paper compares TFoC with several existing methods, a controlled comparison with simpler temporal aggregation mechanisms would help establish the contribution of the proposed focusing design. For example, comparisons with local temporal attention or 3D convolution using the same backbone, temporal window, and training settings would make it easier to understand the advantages of TFoC.
-
The computational evaluation is limited. Tables 2 and 3 report model parameter counts, but do not provide FLOPs, inference latency, or memory consumption. Since TFoC performs feature matching across historical frames and spatial neighborhoods, its computational requirements may increase with the temporal window and search size. Quantifying this overhead would help assess its practical efficiency.
Questions for authors
-
Table 3 reports a substantial improvement on KuRALS-PD. Could the authors clarify the temporal input configurations used by the competing methods? A comparison with existing temporal aggregation approaches using the same number of frames would help isolate the contribution of TFoC's focusing mechanism.
-
Could the authors provide FLOPs, inference latency, and memory consumption for TFoC and representative temporal baselines? It would also be useful to understand how the computational cost changes with the number of historical frames and the spatial search window.
-
The proposed Track Loss is based on semantic labels aggregated across historical frames rather than explicit object trajectories. Could the authors clarify to what extent this supervision captures trajectory consistency, particularly when multiple objects of the same class appear within the same spatial neighborhood?
5 comments
Response to NFqr (part II)
NFqr-R3:Trajectory consistency supervision (Question3)
Thank you for raising this valuable comment.
- The current TCA implements tracking-guided temporal occupancy supervision rather than rigorous trajectory events. If there is only one entity per target class, trajectory consistency among targets of the same class is roughly equivalent to class consistency. When there exist multiple instances for targets of the same class, the current version of TCA only imposes supervision on class consistency, and the supervision over trajectory consistency is weakened. We will supplement this in revised manuscript. Nevertheless, existing RSS datasets (CARRADA, CARRADA-RAC, KuRALS-CW, and KuRALS-PD, all included in the experiments of this manuscript) lack instance-level labels for multiple targets of the same class, which prevents us from realizing effective supervision of instance-level trajectory consistency within TCA.
- However, this does not undermine the effectiveness of our proposed TCA (Track Loss) module in boosting RSS performance. The core role of TCA in TFoC is to fully leverage the trajectory consistency (i.e., continuity) of targets across historical frames, which has been validated by the ablation experiments on Track Loss in Section 4.2. Furthermore, we present a detailed analysis of the continuity of all datasets in Appendix D1. Since KuRALS-PD and CARRADA-RAC exhibit superior continuity compared to KuRALS-CW, Track Loss yields a more pronounced performance improvement for RSS on these two datasets. All these findings sufficiently demonstrate that TFoC effectively utilizes trajectory continuity and could improve RSS results.
Response to Authors and Final Assessment
Thank you for the detailed responses and additional experiments. The controlled comparisons with other temporal aggregation methods address my main concern and strengthen the paper. The clarification regarding Track Loss is also helpful.
Overall, I appreciate the additional experiments and will maintain my current rating.
Response to NFqr (part I)
NFqr-R1:Controlled comparison with simpler temporal aggregation (Weakness1)
Tab. NFqr-R1-T1 presents additional ablation studies on temporal aggregation based on the TFoC backbone: temporal averaging (including average / sum / max pooling), 3D convolution and matched local attention. The comparison that holds the backbone, the context length, the search support, and the training protocol fixed. The experimental results further verify the effectiveness of TFoC.
We further provide the results of “GT-guided TFoC” , which replaces the learned correspondence with the ground-truth class (historical labels) match. This model represents the performance ceiling of TFoC. The relevant results have validated the effectiveness of the core idea (spatio-temporal alignment mechanism) behind TFoC.
Table NFqr-R1-T1. Ablation studies on temporal aggregation. Bold: best. Italic: second best.
NFqr-R2:Temporal input of the baselines (Question1)
We fully agree with your comment. The number of input frames for each network in Table 3 is not uniform, which is constrained by practical conditions. Specifically, FCN, U-Net, DeepLabv3+, HRNet, Swin-T, SegFormer, RSSNet, and KuRALS-Net take 1 input frame, i.e., only the target frame. TMVA-Net, PKCIn-Net, and TARSS-Net use 5 input frames. All these results are cited from published papers. Among the aforementioned methods, except TMVA-Net and TARSS-Net, the network designs do not focus on temporal modeling. Therefore, we cannot introduce multi-frame temporal relations into these methods, as that would constitute secondary innovation on top of them. Since TARSS-Net outperforms TMVA-Net under the same input frame setting, it is sufficient to compare TFoC with TARSS-Net with the same number of input frames. We retrained TARSS-Net following the temporal parameter settings of TFoC, i.e. t=12 on KuRALS-PD, t=8 on KuRALS-CW and t= 9 on CARRADA and CARRADA-RAC, the results are shown in Tab.NFqr-R2-T1.
Table NFqr-R2-T1.