acceptodds
Under review as a conference paper at ICLR 2027

Reliability-Aware Temporal Multimodal Fusion of LiDAR and 4D Radar for Adverse-Weather 3D Object Detection

Abstract

Robust 3D object detection under adverse weather conditions is critical for safe autonomous driving. Weather-robust 4D Radar can effectively mitigate challenges such as the loss of foreground points that occur with LiDAR under adverse weather conditions. Nevertheless, 4D Radar suffers from limitations such as low resolution, which makes LiDAR and 4D Radar fusion still struggle to fully observe targets under adverse weather conditions in individual frames. To address the limitations of individual observations, this work presents the first multi-frame temporal information fusion for LiDAR-4D Radar 3D object detection in adverse weather. However, multi-frame temporal fusion of LiDAR and 4D Radar in adverse weather faces two key challenges: the accumulation of temporal noises and unreliable historical observations. Consequently, naive temporal fusion of LiDAR and 4D Radar brings little or no gain and can even underperform the single-frame baseline. To address these challenges, we propose TMF, a multi-frame temporal fusion framework for adverse-weather 3D object detection. First, instead of treating all frames as equally valid evidence, the Temporal Radar Denoising (TRD) block performs reliability-aware temporal reweighting, discounting clutter at aggregation time so that noise no longer accumulates across frames. Subsequently, the Radar-Guided Temporal Compensation (RGTC) block performs sparsity-guided cross-modal retrieval, querying historical LiDAR features where 4D Radar reveals missing observations, and the Degradation-aware Gated Prior Fusion (DGPF) block gates the retrieved features against the current frame to focus on the important information. Extensive experiments on K-Radar dataset demonstrate consistent improvements across weather conditions, including an average gain of 6.49% AP 3D in adverse weather.

Primary area:
applications to computer vision, audio, language, and other modalities
Keywords:
Autonomous driving, 3D object detection, Adverse weather, MultiModal Learning, Multi-frame temporal information fusion

Reviews

Among:
Shape:
1234this paper, Top 15%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 3.00 over 3 reviews, above 85% of the others.
Reviewer_TEvqOpenReview ↗
Rating
3(+1)
Confidence
3
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

This paper proposes TMF, a framework for 3D object detection using LiDAR and 4D radar in adverse weather conditions. It employs TRD to suppress noise across multiple radar frames, utilizes RGTC to retrieve historical LiDAR features based on radar priors, and incorporates DGPF to perform degradation-aware gating for temporal compensation. Performance improvements in adverse weather conditions are demonstrated on the K-Radar dataset.

Critical strengths

(1) Adverse weather conditions can lead to sparse foreground data and a loss of structural information in LiDAR point clouds, whereas 4D radar remains relatively stable in rain, snow, and fog. Leveraging historical observations to compensate for the degradation of the current frame is a compelling area of ​​research within the context of LiDAR–4D radar fusion.

(2) The paper reports results across two protocols (K-Radar V1.0 and V2.0), two IoU thresholds (0.5 and 0.3), and seven weather conditions. It also includes analyses of temporal length, Top-K ratios, component contributions, and computational overhead.

Critical weaknesses

(1) The core performance gains shrink significantly when compared against a strictly matched baseline. In Table 4, the L4DR baseline used for the component ablation study achieves an overall AP3D of 56.64, while the full TMF model reaches 57.77, representing an actual net gain of only +1.13. The 6.49% AP3D gain highlighted in the abstract and the contributions section actually corresponds to the comparison involving the original L4DR or L4DR-MF (as shown in Table 1), rather than the temporally-matched baseline presented in the appendix.

(2) The mechanism for the spatiotemporal alignment of historical LiDAR features remains unclear. In Figure 2, "ego-motion alignment" is explicitly depicted only for the 4D radar branch; for the LiDAR branch, the data proceeds directly from voxelization into the BEV encoder and memory bank. Neither the main text nor the appendix explains how historical LiDAR point clouds or BEV features are transformed into the current coordinate system using ego-pose information, nor is there any description of how dynamic objects are handled.

(3) The temporal baselines are too weak, and the inclusion of additional supervision in DGPF compromises fairness. InterFusion-MF and L4DR-MF merely concatenate multi-frame point clouds, representing the most rudimentary type of temporal baseline. Furthermore, the paper fails to provide comparisons with other temporal approaches (e.g., QTNet [1], MSF [2]).

(4) The claim of "consistent improvements" is not supported by the experimental results. In Table 4, performance under "Fog" and "Rain" conditions shows a decline relative to the matched baseline. Similarly, in Table 1, the TMF results are lower than those of REL for the "Overcast" (71.1 vs. 71.5), "Rain" (53.8 vs. 55.4), and "Light Snow" (67.2 vs. 67.4) categories. Furthermore, at IoU=0.5 on V2.0, performance for "Sedan" under "Sleet" conditions, as well as for "Bus/Truck" under "Overcast" and "Light Snow" conditions, also shows a decline. While the paper may claim advantages overall or under certain challenging weather conditions, it cannot claim consistent improvements across all weather types and evaluation protocols.

(5) The object gate in DGPF utilizes a binary cross-entropy (BCE) loss and a foreground-background contrastive loss, both derived from ground-truth (GT) bounding boxes; however, the primary baseline lacks equivalent additional supervision. Consequently, some of the performance gains observed in the full model may stem from this extra GT-based gate supervision rather than from the reliability-aware temporal fusion mechanism itself. This appears to be a general module, seemingly tangential to the core problem addressed in the paper: object detection under adverse weather conditions.

[1] Query-based Temporal Fusion with Explicit Motion for 3D Object Detection

[2] MSF: Motion-guided Sequential Fusion for Efficient 3D Object Detection from Point Cloud Sequences

Questions for authors

(1) The method proposed in the paper is based on the fusion of LiDAR and radar modality. Why is the visualization presented from the camera's perspective?

3 comments

We thank the reviewer for the thoughtful comments and feedback. Our point-to-point responses are as follows.

W1: The performance gains are modest.

We acknowledge that the overall gain is modest and varies across weather conditions. Compared with adapted L4DR, TMF improves overall AP3D from 56.64% to 57.77% (+1.13 points). Gains occur under Normal (54.49% vs. 60.04%), Overcast (68.42% vs. 71.05%), Sleet (50.58% vs. 51.22%), Light Snow (62.82% vs. 67.24%), and Heavy Snow (40.33% vs. 46.84%) conditions, while decreases occur under Fog (77.33% vs. 75.99%) and Rain (54.01% vs. 53.75%). The results show benefits across several conditions, although decreases in others offset some gains. We attribute this partly to variations in data distributions across weather conditions. The 6.49% AP3D gain in the Abstract and Contributions is relative to original L4DR. We have clarified the statements.

W2: Insufficient clarification of ego-motion alignment in the LiDAR branch and the handling of dynamic objects.

Historical LiDAR features retrieved from Memory Bank are aligned with current frame using ego-pose information before temporal fusion. We have clarified the process in the manuscript. TMF uses reliable historical cues to compensate for missing target information in current frame. For dynamic objects, TMF implicitly learns to reduce contribution of unreliable historical cues caused by residual motion misalignment, mitigating the interference with current frame predictions.

W3: Lack of comparisons with other temporal approaches.

We added QTNet [1] and MSF [2] baselines by using MTM and BiFA blocks into L4DR's LiDAR branch, respectively, with concatenated multi-frame Radar inputs. All methods use identical inputs and backbones. Results on K-Radar V1.0 at IoU=0.5 are shown below. Additional results are provided in the manuscript.

MethodsTotalNormalOvercastFogRainSleetL-SnowH-Snow
L4DR+MSF53.154.165.966.952.845.755.344.5
L4DR+QTNet53.954.366.267.752.947.562.132.6
TMF (Ours)57.860.071.176.053.851.267.246.8

W4: The claim of "consistent improvements" is not supported by the experimental results.

We acknowledge that the results do not show consistent gains across all weather conditions. Thus, we have revised relevant statements throughout the Abstract, Contributions, experimental analysis, and Conclusion to avoid overstatement.

W5: Potential performance gains from additional GT-based gate supervision and unclear relevance of DGPF to adverse-weather object detection.

First, we conducted an ablation study by only removing GT-based gate loss (Appendix). AP3D decreases from 57.77% to 57.62% at IoU=0.5 and from 79.37% to 79.06% at IoU=0.3, indicating a marginal contribution from the supervision. Second, DGPF is designed to mitigate weakened target responses in adverse weather. It assesses local information reliability based on current and historical responses, inter-frame discrepancies, and historical temporal variability. The gates learn the reliability cues to regulate temporal compensation.

MethodsIoUTotalNormalOvercastFogRainSleetL-SnowH-Snow
w/o gate loss0.379.0681.9688.8489.4677.1369.3587.8956.67
w/o gate loss0.557.6259.6966.9779.5854.4743.8465.2149.12
w/ gate loss0.379.3782.1289.0289.0577.2267.0288.4655.63
w/ gate loss0.557.7760.0471.0575.9953.7551.2267.2446.84

Q1: Lack of justification for using camera-view visualizations in a LiDAR–Radar fusion method.

Following REL [3], we use the camera view solely to provide a more intuitive visualization of detection results.

[1] Hou J, Liu Z, Zou Z, et al. Query-based temporal fusion with explicit motion for 3d object detection[J]. Advances in Neural Information Processing Systems, 2023, 36: 75782-75797.

[2] He C, Li R, Zhang Y, et al. Msf: Motion-guided sequential fusion for efficient 3d object detection from point cloud sequences[C]//2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2023: 5196-5205.

[3] Tong T, Liu X, Liu H, et al. Towards accurate 3D object detection in adverse weather by leveraging 4D radar for LiDAR geometry enhancement[C]//Proceedings of the AAAI Conference on Artificial Intelligence. 2026, 40(12): 9548-9556.

Thanks for the authors' response. My concerns have been addressed. I decide to raise my score to 3.

Thank you, Reviewer TEvq, for your insightful comments and positive reassessment of our work. We have incorporated most of the revisions and clarifications addressed in our rebuttal into the manuscript and appendix. We will further refine their presentation to make the final version more concise and consistent.

Reviewer_kGArOpenReview ↗
Rating
4(+1)
Confidence
4
Informativeness
3
Presentation
2
Soundness
3
Read review
Paper summary

The paper focuses on adverse-weather 3D object detection for autonomous driving, and does temporal multimodal fusion of LiDAR and 4D radar for it. This is a challenging task, as both modalities do not always observe the targets under adverse weather, and there is noise accumulation over time. The paper proposes a tailored framework coined TMF, which contains a Temporal Radar Denoising (TRD) that does temporal reweighting and discard clutter, a Radar-Guided Temporal Compensation (RGTC) block that performs sparsity-guided cross-modal retrieval by querying historical LiDAR features where radar reveals missing observations, and a Degradation-aware Gated Prior Fusion (DGPF) block that gates the retrieved features against the current frame. The experiments are done on the K-Radar dataset and show consistent performance improvements across weather conditions for multiple cases, and limited impact in other cases.

Critical strengths

The background story and citations are well presented, including strengths and weaknesses of LiDAR and radar, and previous attempts to fuse them for adverse weather applications. The Related Work section nicely presents prior work and the distinction of the authors’ work to it. The Experiments are strong and provide evidence that the method is effective across most weather conditions. The conducted ablation studies are informative and provide relevant information about the contribution of each module and the trade-off in terms of latency and parameters.

Critical weaknesses

The main weaknesses concern (1) general unclarities, and (2) unclear relation between the L4DR and TMF method. These concerns are detailed below.

(1) Figure 1 is rather unclear, see "Questions For Authors" for details. Moreover, in lines 106-114, the first two contributions seem to me like one contribution, where the functionality of TMF is split across the first two contributions for some reason. Additionally, I am not sure if the analysis of Figure 1 is fully novel, but if it is, the authors should consider adding its analysis as a contribution in the bullet list. In Figure 2 at the top left it might have helped the reader if the authors used the notation Pt−k:tL\mathcal{P}^L_{t-k:t} and Pt−k:tR\mathcal{P}^R_{t-k:t} instead of the arrows and variable tt. Lines 195-200 repeat the challenges again, and I don’t find it necessary, as the authors could just reference ”the mentioned challenges” and focus on the architecture here. In lines 211-212, the subindex ”his” is introduced without mentioning what it stands for. Making use of forward references, e.g. ”TRD (Section 3.2)” in line 202/203, ”RGTC (Section 3.3)” in line 207, and ”DGPF (Section 3.4)” in line 207 might help the reader. A generic "filtering operation" is mentioned on line 241, but Top-K filtering had been mentioned before; raising uncertainty for the reader. It seems that VV is the number of voxels, but it could help the reader to write this explicitly. In line 253 I understood that ”his” stands for ”historical”, but it might be clearer to instead use subindexes similar to t−kt-k as was done in previous sections. Line 256, MLP is not defined as an acronym. Figure 3 has a typo in ”Sigmod”, should be ”Sigmoid”. Line 320, BCE acronym is not defined.

(2) In Section 4.2 I understood that the authors build on top of the L4DR model, but perhaps this should have been explicitly mentioned already in Section 3 in the "Overall Architecture" paragraph. The total APBEVAP_{BEV} is almost the same for L4DR-SF, L4DR-MF, and TMF, suggesting that the temporal fusion didn’t have a significant impact in the BEV representation, compared to the AP3DAP_{3D} where it is clear that TMF has a positive impact; but the authors did not provide any intepretation of this, which would be valuable for the community. In Table 4, in the first entry where none of TRD, RGTC, and DGPF are used, the total AP3DAP_{3D} is 56.64. However, in Table 1, L4DR-MF results in 53.3 on the same metric. Since TMF is, to my understanding, based on L4DR, I would not have expected such large difference between the two results. The authors did not comment on this, and I think that it would be valuable to hear their interpretation of these results.

Questions for authors

Below are questions that arose while reading the paper and that I recommend the authors to try to address in the paper to the best of their abilities:

  • Which quantities are being shown in Figure 1, subfigures (a), (b), and (c); mAP, something else? Where do these numbers come from, from which experiments with which configuration? Neither the figure caption nor lines 068-074 clarify this.
  • In lines 084-090, I noted that for some weather types, notably ”Overcast” and ”Light snow”, clutter is almost as persistent as target responses. Why do these cross-weather differences happen and what unit do the numbers represent?
  • How is clutter defined? It would be helpful to explicitly define it in one sentence in the introduction, as it is a rather central concept in the paper.
  • What prior work is there on adverse weather perception? A few such works should be cited in the Related Work section, since that is a central topic of the paper, but it does not seem to be explicitly mentioned in the Related Work section.
  • How are LiDAR and radar observations voxelized and how are LiDAR features encoded in lines 200-202? A brief explanation or a reference would help the reader.
  • Line 215, what exactly is ”the detection head”? This is not explained nor is any reference to it provided.
  • In line 229/230, how are ”statistical priors” computed and used?
  • In Section 3.2, how are the four Z\mathcal{Z} variables exactly produced?
  • Do ”drift” and ”motion” in lines 233 and 234 refer to the ego vehicle’s motion?
  • In line 241, why multiplying the set {\mathcal{G}i}{i=1}^V, and why is KVKV a superindex here? Additional clarification would help.
  • Line 256, which kind of MLP is used? Single-layer, multi-layer with how many layers and which hidden dimensions...?
  • Line 257, what does ”are transformed into spatial priors” mean?
  • Line 296/297, what does lightweight encoder mean? A single linear layer, something else...?
  • Line 299/300, what do the object and compensation gates do? Additional clarification might help, even if it was written on the appendix and a forward reference to the appendix was provided in this line.
  • Line 301, do the three priors correspond to near, mid, and far as in Figure 3? If so, make it explicit and briefly motivate why these three. If not, please clarify what the three priors correspond to.
  • Line 302, how is the range normalized? I am concerned that over time the maximum range in each sample varies, and if the normalization done is not a dataset-wide normalization, artifacts could be introduced into DGPF.
  • After lines 422-426, it would be valuable if the authors wrote a few words about why the total APBEVAP_{BEV} might be almost the same for L4DR-SF, L4DR-MF, and TMF, suggesting that the temporal fusion didn’t have a significant impact in the BEV representation, compared to the AP3DAP_{3D} where it is clear that TMF has a positive impact.
  • Also, why might the Sedan class show improvements in AP3DAP_{3D} rather consistently across weather conditions while for Bus or Truck some conditions like Overcast, Sleet, or Heavy Snow show a degradation larger than 10 points for TMF?
  • A crucial clarification that needs to be made: why does the TMF method without any of the TMF modules in Table 4 achieve more than 3 points above L4DR-MF in Table 1, if TMF uses L4DR as a baseline, and TMF without any of its three modules would therefore expected to perform the same as L4DR, instead of more than 3 points better?
5 comments

We thank the reviewer for the thoughtful comments and feedback. Our point-to-point responses are as follows.

W1: General unclarities.

Regarding the first two contributions, the first highlights the key challenges and overall motivation of TMF from a problem-oriented perspective, while the second focuses on how its key blocks achieve temporal information modeling and feature compensation. Figure 1 provides quantitative evidence of potential value of multi-frame observations in adverse weather, motivating the proposed temporal fusion rather than serving as an independent technical contribution. We have also revised other presentation issues accordingly. Specifically, we unified the mathematical notations in Figure 2 and throughout the manuscript, removed repetitive descriptions of the challenges in the overall architecture section, clarified the subscript "his", and added forward references to TRD, RGTC, and DGPF. We also standardized the filtering operation as Top-K filtering, defined (V) as the number of voxels, provided the full names of MLP and BCE, and corrected "Sigmod" to "Sigmoid" in Figure 3. These revisions improve the clarity and consistency of the manuscript.

W2 & Q17&Q19: Unclear relation between the L4DR and TMF method.

First, we have clarified in the Overall Architecture section that TMF is built upon the L4DR framework. Second, The gains in AP3D may be attributed to improved 3D geometric estimation through temporal compensation. Specifically, TMF helps recover incomplete object geometry in the current frame by retrieving reliable historical cues and adaptively fusing complementary features, thereby potentially improving vertical localization and height estimation. These improvements contribute more directly to 3D bounding box overlap. Finally, Table 1 reports the original L4DR, whereas Table 4 uses an adapted baseline with modified network components and data processing to support multi-frame fusion and reduce computational overhead. Thus, the adapted baseline without TRD, RGTC, and DGPF differs from the original L4DR. Further details are provided in the Appendix.

Q1, Q3-Q8, Q11: Insufficient clarification of architectural details and implementation settings.

For clarity, we provide brief responses to the "Questions for Authors" as follows: (1) Figures 1(a)–(c) show percentage-based statistics of BEV occupancy within GT regions, temporal persistence of target and clutter in the same voxel, and overall LiDAR and Radar BEV occupancy, respectively. (3) Clutter refers to non-target Radar response, including weather-related clutter. (4) We have added relevant adverse-weather perception studies to Related Work. (5) LiDAR and Radar voxelization and feature encoding follow L4DR. (6) The detection head also follows L4DR. (7)(8) TRD evaluates Radar voxel reliability using four cues: feature tokens, intensity, neighborhood, and centroid drift. (11) A single-layer MLP is adopted. All eight questions have been addressed in the revised manuscript.

Q2, Q9, Q10, Q12-Q16, Q18: Insufficient clarification of technical details of temporal fusion.

For clarity, we briefly address the relevant questions as follows: (2) Clutter persistence is expressed as a percentage, with variations potentially related to the distribution and temporal stability of non-target scatterers. (9) Drift and motion denote centroid displacement between current and historical point sets in the same voxel. (10) Voxel-specific gating weights regulate local feature contributions, where (V) denotes the number of voxels. (12) The Radar BEV Encoder transforms Radar features into spatial priors for multi-frame LiDAR fusion. (13) The Lightweight Encoder consists of a convolutional layer, normalization, and ReLU. (14) The roles of both gates are explained in the DGPF description. (15) The three priors are Range Context, Local Degradation Cues, and Scene Degradation Cues, capturing range information, local degradation, and scene-level degradation, respectively. (16) Range normalization uses r/R_BEV, where R_BEV is fixed by the BEV grid geometry and shared across all samples, ensuring consistent distance encoding regardless of variations in observation range. (18) Performance differences may stem from the larger size and complex geometry of Bus/Truck, which increase sensitivity to motion misalignment, missing observations, and clutter, making temporal association more challenging.

Dear authors,

Thank you for your thorough work and clarifications. Many of my concerns have been addressed, including clarifying Figure 1, Figure 2, the relation between L4DR and your TMF contributions, and the distinction between historical features hishis and the latest kk frames. Most other concerns have been addressed, which I do not write here for the sake of keeping the text concise.

However, when I read the updated manuscript, a few of my initial concerns remain unsolved:

  1. I would like to insist in my previous observation and suggest that your answer "Clutter refers to non-target Radar response, including weather-related clutter." could be included in the manuscript to help define the central concept of clutter.
  2. I remain concerned about the mathematical soundness of Equation 2 and the inline equation in the line after it. This refers to my previous question "In line 241, why multiplying the set {\mathcal{G}i}{i=1}^V, and why is KVKV a superindex here? Additional clarification would help.". I understand that each voxel receives a reliability score between 0 and 1. Then the KK voxels with best score are kept, but is it so that the ones that are kept are refined by being multiplied by the score? Thank you for writing that VV is the number of voxels, but it is not immediate if these voxels are temporally aggregated over the last kk frames? Writing these clarifications in the manuscript would greatly improve understanding of the TRD module.
  3. For reproducibility and clarity it would help if your answer "Range normalization uses r/R_BEV, where R_BEV is fixed by the BEV grid geometry and shared across all samples, ensuring consistent distance encoding regardless of variations in observation range." was added to the manuscript.
  4. Your answer: "TMF helps recover incomplete object geometry in the current frame by retrieving reliable historical cues and adaptively fusing complementary features, thereby potentially improving vertical localization and height estimation. These improvements contribute more directly to 3D bounding box overlap." is plausible, and I think that it would be valuable to write this kind of interpretation in the experiments section. The same goes for your answer "Performance differences may stem from the larger size and complex geometry of Bus/Truck, which increase sensitivity to motion misalignment, missing observations, and clutter, making temporal association more challenging."
  5. To aid reproducibility, your answer: "The Lightweight Encoder consists of a convolutional layer, normalization, and ReLU." should be written in Section 3.4 the manuscript, or in the Appendix and a reference to it should be provided in Section 3.4.

Due to the remaining concerns, I am keeping my initial scores for now, but remain open to increasing them if a new revision that satisfactorily addresses these is uploaded.

We thank the reviewer for the thoughtful comments and feedback. Our point-to-point responses are as follows.

Q1: I would like to insist in my previous observation and suggest that your answer "Clutter refers to non-target Radar responses, including weather-related clutter." could be included in the manuscript to help define the central concept of clutter.

R1: We have added the following statement to the manuscript (Lines 63–64 on Page 2): “Clutter refers to non-target Radar responses, including weather-related clutter.”

Q2: The mathematical soundness of Equation 2 and the inline equation in the line after it.

R2: We would like to clarify the following aspects. First, Gi\mathcal{G}_i is the learned reliability scores associated with the i-th voxels, rather than a set of voxel features or indices. To avoid potential ambiguity, we have revised mathematical formulation (e.g., removed the set notation for reliability scores indexed over V and KV voxels, as well as the superscript notation KV) in the manuscript. Second, all candidate voxels undergo Top-K filtering. However, the retained voxels are not assigned uniform weights. Instead, each retained voxel is multiplied by its corresponding learned reliability scores, thereby adaptively recalibrating its feature representation. Finally, the voxel features are obtained by temporally aggregating Radar points from the current frame and the most recent k historical frames. Therefore, the resulting voxel representations incorporate both current observations and historical information. We have incorporated these clarifications into the manuscript to provide a clearer explanation of the voxel selection and reliability weighting. (Lines 242–248 on Page 5)

Q3: For reproducibility and clarity it would help if your answer "Range normalization uses r/R_BEV, where R_BEV is fixed by the BEV grid geometry and shared across all samples, ensuring consistent distance encoding regardless of variations in observation range." was added to the manuscript.

R3: We have added the following statement to the manuscript (Lines 317–318 on Page 6): “Range normalization uses r/R_BEV, where R_BEV is fixed by the BEV grid geometry and shared across all samples, ensuring consistent distance encoding regardless of variations in observation range.”

Q4: Your answer: "TMF helps recover incomplete object geometry in the current frame by retrieving reliable historical cues and adaptively fusing complementary features, thereby potentially improving vertical localization and height estimation. These improvements contribute more directly to 3D bounding box overlap." is plausible, and I think that it would be valuable to write this kind of interpretation in the experiments section. The same goes for your answer "Performance differences may stem from the larger size and complex geometry of Bus/Truck, which increase sensitivity to motion misalignment, missing observations, and clutter, making temporal association more challenging."

R4: We have incorporated the following two statements into the manuscript: “TMF helps recover incomplete object geometry in the current frame by retrieving reliable historical cues and adaptively fusing complementary features, thereby potentially improving vertical localization and height estimation. These improvements contribute more directly to 3D bounding box overlap.” (Lines 409–413 on Page 8). “Performance differences may stem from the larger size and complex geometry of Bus/Truck, which increase sensitivity to motion misalignment, missing observations, and clutter, making temporal association more challenging.” (Lines 416–419 on Page 8).

Q5 To aid reproducibility, your answer: "The Lightweight Encoder consists of a convolutional layer, normalization, and ReLU." should be written in Section 3.4 the manuscript, or in the Appendix and a reference to it should be provided in Section 3.4.

R5: We have added the following statement to the manuscript (Lines 309–311 on Page 6): “DGPF first encodes FhisfF_{\mathrm{his}}^{f} using a lightweight encoder consisting of a convolutional layer, a normalization layer, and a ReLU function to obtain the temporal context Fhisf′F_{\mathrm{his}}^{f'}”

Reviewer_Ww9QOpenReview ↗
Rating
2
Confidence
3
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

This paper proposes TMF, a temporal LiDAR–4D radar fusion framework for adverse-weather 3D object detection. The method combines temporal radar filtering, radar-guided aggregation of historical LiDAR features, and degradation-aware gated fusion. Experiments on K-Radar show improvements over the compared baselines in several evaluation settings.

Critical strengths
  • The motivation is practical and reasonable. The method exploits complementary information from historical observations while addressing temporal noise accumulation in adverse weather.
  • TMF improves detection performance over the compared methods on K-Radar dataset, with useful gains under difficult conditions such as heavy snow.
  • Extensive analysis such as temporal-window, filtering-ratio and computational-cost help understand the contributions of the designed modules.
Critical weaknesses
  • The experimental comparisons are insufficient. Recent fusion methods such as FusionBev are missing, which seems achieve better performance. if the code is unavailable, the authors could discuss their reported results/settings and differences from TMF.
  • The contribution of TRD and DGPF is unclear without comparisons to baselines using temporal attention or simple gated fusion.
  • The improvements are relatively small and not consistent across settings. The gain over the adapted baseline is 1.13 AP3D points, while both V2.0 categories perform below L4DR at IoU=0.3.
  • Some key steps are not clearly described, including how the local degradation cues and TRD statistics are calculated, and how RGTC works in Eq. (3).
Questions for authors
  • How does TMF compare with temporal attention or simple gated history fusion under same temporal inputs and backbone settings?
  • Could the authors clarify the additional value of temporal compensation relative to FusionBev’s geometric fusion, and discuss their published results under compatible evaluation settings? If a matched reproduction is infeasible, please explain the limitations.
  • What are the possible reasons of lower overall AP3D for both categories on K-Radar V2.0 at IoU=0.3?
  • Could the authors specify the reliability cues and RGTC interaction, and explain how historical BEV features and moving objects are handled beyond ego-pose alignment?
1 comment

We thank the reviewer for the thoughtful comments and feedback. Our point-to-point responses are as follows.

W1&Q2: Insufficient comparisons with recent fusion methods (e.g., FusionBEV) and discussion of the experimental settings and differences from TMF.

TMF follows L4DR preprocessing, using officially preprocessed K-Radar sparse Radar with [x, y, z, intensity] features and 64-beam LiDAR. In contrast, FusionBEV [1] uses Radar features comprising [x, y, z, RCS, radial velocity, time], and the paper does not specify the LiDAR beam configuration. Its Radar feature ablation is conducted only on VoD. Thus, identical sensor inputs and preprocessing settings cannot be confirmed, making strictly matched comparisons difficult. We have also expanded Related Work discussion of FusionBEV [1]. While FusionBEV focuses on single-frame geometric fusion, TMF exploits reliable historical cues to compensate for degraded current observations.

W2&Q1: Lack of comparisons with temporal attention and simple gated fusion baselines.

We added two temporal baselines (QTNet [2] and MSF [3] ) , by incorporating their MTM and BiFA blocks into the LiDAR branch of L4DR, respectively. Multi-frame 4D Radar are concatenated as Radar inputs. All methods use identical inputs and backbones. Results on K-Radar V1.0 at IoU=0.5 are reported below, showing TMF's advantages in adverse weather temporal fusion. Additional results are provided in the revised manuscript.

MethodsTotalNormalOvercastFogRainSleetL-SnowH-Snow
L4DR+MSF53.154.165.966.952.845.755.344.5
L4DR+QTNet53.954.366.267.752.947.562.132.6
TMF (Ours)57.860.071.176.053.851.267.246.8

W3&Q3: The performance gains are modest and not consistent across settings.

First, TMF improves overall AP3D from 56.64% to 57.77% (+1.13 points) over adapted L4DR. Gains occur under Normal (54.49% vs. 60.04%), Overcast (68.42% vs. 71.05%), Sleet (50.58% vs. 51.22%), Light Snow (62.82% vs. 67.24%), and Heavy Snow (40.33% vs. 46.84%) conditions, while decreases occur under Fog (77.33% vs. 75.99%) and Rain (54.01% vs. 53.75%). These results show benefits across several conditions, although decreases in others offset some gains. We have moderated the relevant claims. Second, TMF achieves slightly lower overall AP3D than L4DR for both categories on K-Radar V2.0 at IoU=0.3. The declines occur under Rain and Heavy Snow for Sedan, and Overcast and Sleet for Bus/Truck. We attribute this partly to variations in data distributions across weather conditions and the expanded detection range and object categories in V2.0, which complicate temporal association. These limitations are discussed in the revised Conclusion.

W4&Q4:Some key steps are not clearly described and insufficient clarification of moving object handling.

We have clarified the key technical steps and dynamic object handling. First, local degradation cues assess local reliability by relative current-region feature activation, historical responses, inter-frame differences, and temporal fluctuations. Second, TRD evaluates Radar voxel reliability using four cues: feature token, intensity, neighborhood, and centroid drift, capturing point-level features, temporal intensity variations, local occupancy and spatial statistics, and cross-frame geometric changes based on centroid distances. Third, Eq. (3) corresponds to the RGTC interaction in Fig. 2(b): T(⋅)=τ(Θ(FtR,FtL,FhisL′))+τ(Θ(ER(FtR),EH(FhisL′))).\mathcal{T}(\cdot)=\tau(\Theta(F_t^R,F_t^L,F_{\mathrm{his}}^{L'}))+\tau(\Theta(E_R(F_t^R),E_H(F_{\mathrm{his}}^{L'}))). Finally, we clarify that historical LiDAR features retrieved from the Memory Bank are aligned with the current frame using ego-pose information before temporal fusion. The insufficient description may have caused ambiguity. TMF uses reliable historical cues to compensate for missing current-frame information. For dynamic objects, TMF implicitly learns to reduce the contribution of unreliable historical cues caused by residual motion misalignment during temporal compensation, mitigating the interference with current frame predictions. We have added these details to the manuscript.

[1] Qi Y, Liu C, Wu H, et al. FusionBEV: LiDAR and 4D radar fusion for 3D object detection[J]. Information Fusion, 2026: 104240.

[2] Hou J, Liu Z, Zou Z, et al. Query-based temporal fusion with explicit motion for 3d object detection[J]. Advances in Neural Information Processing Systems, 2023, 36: 75782-75797.

[3] He C, Li R, Zhang Y, et al. Msf: Motion-guided sequential fusion for efficient 3d object detection from point cloud sequences[C]//2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2023: 5196-5205.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.