- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Authors propose COVE, a post-hoc scoring operator for object-level collaborative perception. The paper argues that the ego’s failure to detect a remote proposal should be treated as negative evidence only when the ego was able to observe that region. To this end, the ego computes a ray-based verification opportunity v from its own LiDAR sweep. The score of an uncorroborated remote hypothesis is multiplied by a constant α only when v exceeds a threshold, and is otherwise unchanged. The paper also reports that 31% of the in-range infrastructure-side labels on DAIR-V2X-C have no counterpart in the cooperative annotations, and evaluates on a union of the two label sets. Experiments on DAIR-V2X-C, OPV2V and an OPV2V LiDAR-camera pairing, with frozen proposals and association, show aggregate AP70 gains of 1.9 to 5.7 points on all six holdouts. The gain on ego-invisible objects is significant only on the four simulated holdouts.
Critical strengths
The finding about the DAIR-V2X-C cooperative annotations is useful to the community, independent of the method. Under the released labels, late fusion is far below the ego-only detector (41.0 vs 68.0 AP70), and part of this gap comes from ego-invisible objects being absent from the labels. The evaluation protocol is rigorous and honest. Proposals and association are frozen, holdouts are split by scene in both directions, baselines get the same selection budget, and intervals use a paired bootstrap. The unfavourable results are also reported openly.
Critical weaknesses
The method itself is thin and implements a known principle. The main claim about ego-invisible objects is neither cleanly isolated in the evaluation nor supported on real data. I have the following concerns:
- The contribution is insufficient. The authors admit that the observability-conditioned update is not new, and a very similar check already exists in collaborative perception. In “On Data Fabrication in Collaborative Vehicular Perception: Attacks and Countermeasures” (USENIX Security 2024), each vehicle labels space as free, occupied or unknown, and detected boxes are required to fall in occupied rather than free regions. Computing free space by ray casting is also standard, e.g. “What You See is What You Get: Exploiting Visibility for 3D Object Detection” (CVPR 2020). What I doubt is whether a one-line gate — multiplying by α when v ≥ τ and the box is uncorroborated — is sufficient as the main contribution of a method paper. Propositions 1 and 2 are direct restatements of Bayes’ rule and should not be presented as theoretical results.
- The proxy v is weak. v is computed from the very box whose correctness is being judged. When a remote box is displaced, v measures whether the ego can see the reported location, not the real object. In practice, COVE vetoes 3% to 15% of the remote-only clusters that match a real object on five holdouts, and 30% on DAIR-B. In addition, α is a constant, so a real object missed by the ego detector in a visible region is penalised in the same way as a ghost box. The guarantee in Proposition 2 therefore holds only if 1[v ≥ τ] is a good proxy for observability, which is not shown.
- The evaluation does not isolate the claimed effect. According to Section 5.1, detections matching ground truth outside the evaluated subset are ignored, but unmatched false positives are counted in every subset. Suppressing false positives in free space that the ego can see will therefore also raise the ego-invisible AP, regardless of whether ego-invisible objects are protected. Moreover, naive max-score fusion and score-mean fusion do not explicitly discount uncorroborated boxes, so compared with them COVE mainly adds a free-space false-positive filter. The comparison that actually tests the paper’s idea is COVE versus the τ = 0 variant, and it should be part of the main results.
- The real-data evidence is not convincing. The ego-invisible gain on DAIR is 0.4 and 2.4 points, and both intervals cross zero. The simpler in-box return count beats COVE on this subset (Table 8). Late fusion with COVE remains below the ego alone (46.9 vs 55.6 AP70). The six holdouts are not independent, since the two directions reuse the same scenes and DAIR has only 22 sequences. The union labels add infrastructure-side annotations from the same system on which the infrastructure detector is trained, which may favour the collaborator’s proposals. Finally, the parameter grid is only 2×2 and selects different values on every holdout, and the ego detector is always PointPillars. I believe another real-world dataset and more detectors are needed in order to be convincing.
Questions for authors
- Can you decompose the ego-invisible AP gain into retained ego-invisible true positives and false positives removed elsewhere, e.g. by reporting recall at a fixed precision?
- If the in-box return count matches or beats COVE on real data, what does ray reachability add? On a new dataset, how would you choose between them?
- Can you report the rates of {v ≥ τ, Y = 1} and {v < τ, Y = 1} to show how far 1[v ≥ τ] is from the latent observability?
- How sensitive is the 31% to the de-duplication thresholds (BEV IoU ≥ 0.1 or centre distance < 2.5 m) and to pose error? Has it been checked manually?
- Can the ego-invisible effect on real data be established with more sequences, another real dataset or more detector seeds?