- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ObjDec, a camera–LiDAR–4D-radar fusion framework that explicitly decomposes aligned BEV patch tokens into shared and modality-specific representations. Foreground-grounded constraints are combined with foreground gating, modality contribution control, and object-context modulation. The method is evaluated mainly on K-Radar v1/v2, with additional V2X-Radar-V experiments and extensive representation/gating analyses.
Critical strengths
- The representation-decoupling perspective is meaningful for multi-sensor fusion because it explicitly separates cross-modal agreement from modality-specific complementary cues and ties both to detection-relevant foreground regions.
- The diagnostic analysis is relatively transparent: the paper reports confidence-threshold sensitivity, representation statistics, spatial-gate interventions, component ablations, and transfer to another dataset.
Critical weaknesses
- A highly relevant prior work is missing: 'Multi-Modal Decouple and Recouple Network for Robust 3D Object Detection' (Ding et al., 2026) already decomposes camera/LiDAR BEV features into modality-invariant and modality-specific parts before adaptive recoupling. Since this overlaps directly with ObjDec's core shared/specific decomposition, the paper must cite it and clearly establish what is methodologically new beyond object-guided supervision and ASF-based fusion control.
- The headline K-Radar v1 gain is strongly operating-point dependent. The large improvement at confidence 0.3 and IoU 0.3 shrinks substantially at stricter IoU; at IoU 0.5 the overall gain over ASF is very small, and sleet performance degrades markedly. The current 'SOTA' framing overemphasizes a favorable threshold/IoU configuration.
- The main comparison is not fully controlled. The manuscript explicitly states that published baselines use non-uniform labels, preprocessing, and evaluators, so ranking ObjDec against those numbers is not a clean SOTA comparison. The strongest claims should rely on reproduced baselines under an identical protocol.
- The ablation does not isolate the actual decoupling architecture. 'w/o decoupling supervision' keeps both shared/specific branches and their forward paths; therefore it tests the auxiliary losses, not whether explicit shared/specific decomposition itself is necessary. A true no-decoupling baseline such as simple concatenation or a single shared projection is required.
- The role of object-context modulation is internally unclear. Removing the query/output context increments at inference changes AP by almost zero, whereas retraining without object context causes a large drop. This suggests that the branch may act mainly through auxiliary supervision or optimization rather than through the claimed inference-time context modulation, and these effects should be separated.
Questions for authors
- How does ObjDec differ from Ding et al. (2026), 'Multi-Modal Decouple and Recouple Network for Robust 3D Object Detection,' and why is this closely related decomposition framework not cited or compared?
- Can the authors provide a fully matched ASF comparison with identical preprocessing, evaluator, confidence filtering, training schedule, and checkpoint selection?
- Can the authors add a true no-decoupling/Concat baseline to isolate the architectural contribution from the auxiliary supervision and extra branches?
- What is the exact origin of the 1,000-frame K-Radar v1 checkpoint-selection subset, and is it strictly disjoint from the final test set at the sequence/frame level? Please also explain the near-zero inference effect of the object-context increments.
- Also, i think more R+C 3D object detection methods should be included for discussion, such as SGDet3D, RaGS, SIFormer.
- I will improve my score if authors address the issues above.
2 comments
To Reviewer TmAt
Dear Reviewer TmAt,
We hope this message finds you well. With the deadline of discussion period is approaching, we wanted to make sure we have fully addressed your concerns. If you have any further points or feedback you would like us to consider, please let us know. Your insights are invaluable to us, and we are open to any further suggestions you might have to improve the paper.
Thank you for the time and effort you have dedicated to reviewing our paper.
Best regards,
The Authors
Thanks and Response to Reviewer TmAt
Thank you for pointing us to Ding et al. and for distinguishing the contribution of the shared/specific architecture from that of its supervision. We address both questions below and report two additional controlled experiments.
Q1. Relation to Ding et al.
Both methods learn shared and modality-specific BEV features. Ding et al. use an invariant encoder shared across camera and LiDAR, an auxiliary detection head and adaptive recoupling. ObjDec uses separate mappings for each sensor and applies its representation losses at aligned foreground patches. At each patch, the learned features determine how strongly to update each sensor token and how to weight the available sensors before local attention. We will cite Ding et al. and make this connection between foreground supervision and local fusion control explicit in the introduction and related work.
Q2. Matched ASF comparison
On V2X-Radar-V, ASF and ObjDec use the same three sensors, encoder and detection-head architectures, 0.16 m grid and 80-epoch schedule. Both use the same evaluator, head score threshold (0.001) and rotated NMS threshold (IoU 0.1). Both select checkpoints by mean Moderate 3D AP on the same validation split and use the same deduplicated test set.
V2X-Radar-V test AP (Table 4b).
K-Radar v1 3D AP at IoU 0.5 and export threshold 0.3 (Table 1).
On v1 the overall gain is 0.31 points, with an improvement in rain and a drop in sleet. Tables 1 and 9 use the official ASF checkpoint
model_10.ptand evaluation archiveexp_250303_200024_A2F_v1_0. Table 1 reports export threshold 0.3. Table 9 repeats 0.3 and adds 0.0, with the head prefilter fixed at 0.1. We will correct the Table 1 caption .Q3. Does the shared/specific architecture improve on direct fusion?
All four variants retain task supervision. The first two omit both representation branches. Raw-token control predicts the fusion controls directly from the original tokens. The last two rows have identical architectures.
R2. Fusion ablation. Scores are 3D AP.
At 79.47M parameters, full ObjDec exceeds raw-token control by 5.41 AP points at IoU 0.7 (22.04 vs. 16.63). With the representation losses off, the two branches score 16.49, close to raw-token control. Enabling the three losses within the same architecture raises AP by 5.55 points.
Q4. Validation split and object context
We reserved a fixed set of 1,000 frames to select the v1 ObjDec and ablation checkpoints. None appears among the 10,065 final test frames.
We retrained all four settings with the same budget, other losses and modules. Turning injection off disables both the query and output increments.
R1. Context ablation. Scores are 3D AP.
At IoU 0.7, enabling injection during training adds 3.51 points with context supervision (A−B) and 0.14 without it (C−D). Adding supervision gives 4.80 points with injection (A−C) and 1.43 without it (B−D). At the same IoU, disabling both increments only at inference changes AP from 22.0603 to 22.1096 (+0.0493, Table 14). In these runs, training with injection improves the supervised model’s final AP, while the trained checkpoint is only weakly sensitive to the residuals at inference.
Q5. Radar–camera detectors
We will discuss SGDet3D’s fusion of radar geometry and image semantics, RaGS’s use of radar and monocular cues to construct 3D Gaussians, and SIFormer’s cross-view instance correspondence alongside our approach to controlling fusion at aligned BEV patches.