- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
RCQFusion is a sparse radar-camera query-based 3D detector that avoids dense BEV fusion. It combines a density-aware radar Transformer, sampling-enhanced radar-to-image fusion, radar-/camera-conditioned multi-modal query generation, and dynamic one-to-many auxiliary matching. The paper reports strong nuScenes results, long-range/motion/weather analyses, matched runtime comparisons, and additional MAN TruckScenes evaluation.
Critical strengths
- The sparse radar-centric design is well motivated. Avoiding dense BEV grids is a natural match for sparse radar measurements, and the matched runtime/memory comparison provides concrete evidence for a useful accuracy-efficiency trade-off.
- The paper includes informative distance-, velocity-, weather-, and long-range analyses, which show where radar cues help rather than relying only on aggregate mAP/NDS.
Critical weaknesses
- The novelty over RaCFormer is not sufficiently strong under the most controlled comparison. With the same ResNet-50 backbone and 704×256 input, RCQFusion improves mAP only modestly while NDS is identical. Since both methods are query-based radar-camera detectors, the paper needs a sharper explanation of what fundamentally changes beyond a more elaborate radar/query initialization pipeline.
- The most relevant sparse radar-camera baseline, SpaRC, is not quantitatively compared even though the paper explicitly discusses it as a sparse non-BEV alternative. For a work whose central claim is sparse radar-camera fusion, omitting a controlled SpaRC comparison is a major gap.
- The radar-camera related-work coverage is incomplete. Recent works SGDet3D (RAL 2024), SIFormer (TMM 2026) studies cross-view instance-aware 4D radar-camera fusion and reports results on nuScenes; RaGS (CVPR 2026) also represent advanced rc fusion paradigm. SIFormer is particularly important because a nuScenes comparison is feasible.
- The main ablations do not cleanly isolate the claimed contributions. The final row bundles multi-source query generation with hybrid matching, while the density-aware radar encoder is validated mainly in a simplified radar-only setting. Therefore, the paper does not establish how much each major component contributes inside the full RCQFusion detector.
- The strongest test-set 'SOTA' number is confounded by backbone/resolution escalation. The 0.640/0.686 result uses a high-resolution ViT/EVA-02 configuration, whereas the matched VoV-99 result is weaker than RICCARDO in NDS and the matched ResNet-50 gain over RaCFormer is small. The paper should separate method gains from backbone scaling and avoid presenting the best configuration as evidence of architectural superiority.
- More experiments on view-of-delft, omnihd-scenes, tj4dradset should be conducted, if so, i will improve my score.
Questions for authors
- Can the authors provide a controlled comparison with SpaRC under matched backbone, resolution, training schedule, and evaluation settings?
- Can the authors separately ablate multi-source query generation and hybrid matching in the full detector, and report the density-aware radar encoder's contribution inside the complete fusion pipeline?
- How much of the test-set improvement remains under the same backbone/resolution as the strongest prior radar-camera methods? Please distinguish architectural gains from backbone scaling.
- Can the authors conduct more experiments on more datasets, such as view-of-delft, omnihd-scenes, tj4dradset.
2 comments
Part II. Matched Comparisons, Cross-Dataset Generalization, and Architectural Coherence
R5 To W5/Q3. Backbone Effects and Matched Comparisons
As stated in the main paper, we primarily conduct fair comparisons on the nuScenes validation set, where backbones, input resolutions, and training settings can be better aligned, as many methods do not publicly disclose their complete test-set configurations.
Our strongest nuScenes test result (64.0% mAP / 68.6% NDS) uses EVA-02 ViT at 1600×800. We distinguish this configuration from matched-backbone comparisons to clarify architectural gains.
With VoVNet-99 at 1600×640, RCQFusion achieves 61.2% mAP / 66.3% NDS on nuScenes test, compared with RaCFormer's 59.2% / 65.9%, using Train-only data without future-frame inference.
RICCARDO reports 63.0% / 69.5% on test using Train+Val (~34K frames), whereas our 61.2% / 66.3% model uses Train only (~28K frames). Under the matched Train-only validation protocol with ResNet-101 at 1408×512, RCQFusion achieves 57.4% / 63.7%, compared with RICCARDO's 54.4% / 62.2% (+3.0 mAP / +1.5 NDS points).
These matched comparisons, together with the efficiency results in Part I, demonstrate the accuracy–efficiency advantages of RCQFusion beyond backbone scaling. For RICCARDO's training-only future radar sweeps and the detailed comparison protocol, see rBvM-R2/W2/Q2.
R6 To W6/Q4. Generalization to 4D Radar: TruckScenes and VoD
RCQFusion is primarily designed for sparse and noisy radar measurements, particularly those from widely deployed conventional 3D radars. Its point enhancement and sparse fusion modules specifically address low point density and the absence of elevation information in such radars. We further evaluate its generalization to 4D radar datasets as reported in the supplementary material of our original submission.
MAN TruckScenes. RCQFusion achieves 23.9% mAP / 36.0% NDS with 900 queries, increasing to 24.7% / 38.6% with 1600 queries. For comparison, Horizon3D (arXiv submitted June 30, 2026) reports CRT-Fusion (16.9% / 28.8%), BEVFusion (18.2% / 30.4%), and SpaRC stated (22.5% / 35.4%) on TruckScenes.
View-of-Delft (VoD). VoD has only one front camera, providing limited coverage that is unfavorable for our projection-based radar–camera fusion, as many radar points cannot be associated with camera features. Nevertheless, with only a simple adaptation, RCQFusion achieves competitive results using ResNet-50 and 24 training epochs, retaining its core sparse fusion and heterogeneous query design.
Under the AP11 protocol, our new results are:
| Region | Car AP | Ped. AP | Cyc. AP | 3D mAP |
|---|---|---|---|---|
| Entire | 49.56% | 54.12% | 71.72% | 58.47% |
| ROI | 69.26% | 64.59% | 89.15% | 74.34% |
VoD Entire 3D mAP (ResNet-50):
| Method | 3D mAP |
|---|---|
| RCFusion | 49.65% |
| RCBEVDet | 49.99% |
| RaCFormer | 54.44% |
| RCQFusion (Ours) | 58.47% |
| SGDet3D | 59.75% |
| SIFormer | 60.18% |
| CVFusion | 60.29% |
SGDet3D uses geometric depth completion and Radar PillarNet; SIFormer combines depth-guided localization and cross-view instance enhancement; and CVFusion adopts radar-guided BEV fusion and two-stage proposal refinement.
RCQFusion achieves 58.47% Entire mAP / 74.34% ROI mAP through a simple adaptation of our original sparse 3D radar–camera framework, outperforming existing 3D radar–camera fusion methods, including RCFusion, RCBEVDet, and RaCFormer.
Notably, these results are achieved without 4D radar-specific tuning for higher point density or elevation information, complex temporal feature interactions, multi-stage pretraining or fine-tuning, or auxiliary LiDAR-based depth supervision. Together with TruckScenes, these results demonstrate the generalization of RCQFusion across different radar sensing configurations.
VoD adaptation is ongoing. We will release the code and weights via an anonymous link before the rebuttal deadline.
TJ4DRadSet and OmniHD-Scenes. Similar to TruckScenes, both provide 4D radar data, but access approval may take over a week. We are applying for access and will add results in the revision once available.
R7. Architectural Coherence and Revision
RCQFusion forms a unified sparse pipeline: density-aware encoding preserves radar geometry and motion cues; radar-anchored fusion incorporates camera semantics; heterogeneous queries generate complementary object hypotheses; and Dynamic-K matching resolves assignment competition.
We will add approximately one page to the revised PDF's main text to clarify these structural connections and distinguish RCQFusion from dense-BEV fusion, RaCFormer, query-based methods, and recent 4D radar fusion and refinement approaches.
Part I — Architectural Novelty, SpaRC, and Ablations
R1 To W1. Architectural Novelty vs. RaCFormer
Although both methods employ query decoders, their core contributions and fusion architectures differ substantially.
RaCFormer focuses on cross-perspective query-based fusion, introducing circular query initialization, radar-aware depth prediction, and an implicit dynamic catcher to enhance BEV representations. Its decoder repeatedly samples image, radar-BEV, and camera-BEV features, including interactions with seven historical feature frames.
RCQFusion instead develops a unified sparse radar–camera detection pipeline through four connected designs: (1) density-aware point-level radar encoding; (2) radar-anchored camera sampling and sparse fusion before decoding, avoiding dense radar–camera BEV construction; (3) physics-guided heterogeneous queries initialized from radar measurements and radar–camera associations, alongside camera and historical queries; and (4) Dynamic-K matching to address assignment competition among heterogeneous queries.
Unlike RaCFormer's spatially distributed circular queries, our radar-originated queries represent measurement-grounded object hypotheses. Our sparse fusion and query-memory design also avoids repeated interactions with dense historical feature maps.
Under the same ResNet-50 backbone and 704×256 resolution, RaCFormer achieves 54.1% mAP / 61.3% NDS using seven historical feature frames, while RCQFusion achieves 55.0% / 61.3% without historical feature-map interactions. RCQFusion further reduces latency from 216.0 to 56.1 ms and peak memory from 4.55 to 2.76 GB, achieving 3.9× faster inference with 39% lower memory.
For detailed efficiency profiling, see SuzS-R3/Q1. Our framework-level novelty is further explained in rBvM-R5/W3 (Part II).
R2 To W2/Q1. SpaRC Comparison
During our submission preparation, SpaRC was mainly available as an arXiv preprint, with its official publication appearing on September 30, 2026. Our attempted reproduction reached only 26.3% mAP / 43.6% NDS due to missing official code and implementation details, preventing a reliable controlled comparison. See SuzS-R2/W2 for details.
As requested, we include SpaRC's originally reported nuScenes validation results. With R50 (704×256), RCQFusion achieves 55.0%/61.3% vs. SpaRC's 54.5%/62.0% (mAP/NDS); with R101 (1408×512), 57.4%/63.7% vs. 57.1%/64.4%. RCQFusion has slightly higher mAP, while SpaRC has higher NDS.
R3 To W3. Recent Radar–Camera Methods
Our work primarily focuses on sparse 3D radar and compares against methods designed for the same sensing configuration. Unlike 4D radar, conventional 3D radar produces sparse, noisy, and non-uniformly distributed measurements with limited spatial accuracy and elevation information. These characteristics motivate our density-aware encoding, radar-anchored sparse fusion, and physics-guided query generation.
Recent methods such as SGDet3D, SIFormer, CVFusion, and RaGS primarily target 4D radar with richer spatial measurements. SGDet3D employs geometric depth completion and Radar PillarNet; SIFormer introduces depth-guided localization and cross-view instance enhancement; CVFusion uses radar-guided BEV fusion and two-stage proposal refinement; and RaGS constructs Gaussian representations and renders BEV features. In contrast, RCQFusion preserves sparse radar point-level geometry and constructs heterogeneous object queries without dense BEV fusion.
On nuScenes validation, RCQFusion achieves 55.0% mAP / 61.3% NDS, compared with SIFormer's 46.0% / 56.8% under the same ResNet-50 backbone and 704×256 resolution (+9.0 mAP / +4.5 NDS points). Additional comparisons on 4D radar datasets are provided in Part II (W6/Q4).
R4 To W4/Q2. Independent Ablations
The final row of Table 3 is ambiguously labeled: “Multi-source Queries” refers to query sources already introduced in preceding rows, rather than a new module.
Table 3 progressively evaluates radar queries (+1.0 mAP / +0.5 NDS), radar–camera 2D queries (+0.8 / +0.3), and Dynamic-K hybrid matching (+1.7 / +1.7, from 53.9%/60.4% to 55.6%/62.1%). We will rename the final row “+ Dynamic-K Hybrid Matching.” For a detailed breakdown of each component's contribution, please refer to SuzS-R5/Q3.
Our density-aware encoder is structurally coupled with downstream sparse fusion and query generation, making direct replacement with pillar-based encoders impractical without redesigning these modules. Table 6 therefore provides controlled radar-only ablations, where density-aware encoding achieves 21.21%/29.54%, versus 20.31%/27.23% for distance-aware attention (mAP/NDS). For these structural dependencies, see rBvM-R5/W3 (Coherent Representation-to-Prediction Design).