- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses a fairly specific problem in collaborative perception: if an attacker repeatedly omits or fabricates one critical object while reporting other objects correctly, the vehicle may still receive a high trust score when all its reports are pooled. The authors propose SABER, which retains an overall trust estimate but also uses CUSUM to identify agent–track pairs with persistent anomalies. It then uses observations from other vehicles to update a separate trust score for each selected pair. A low score for any pair under assessment can lower the vehicle’s final trust score. To me, the central idea is to prevent a large number of correct reports from masking a sustained attack on a single object. The authors evaluate object removal and spoofing attacks on OPV2V under both late and intermediate fusion. Based on the reported results, SABER improves the trade-off between detection and false alarms, with particularly strong results against sustained spoofing attacks.
Critical strengths
-
The theoretical analysis is very thorough. I consider this the most valuable part of the paper. The authors not only propose a mechanism for keeping separate evidence for each agent–track pair, but also analyze cross-object evidence dilution, reductions in trust scores, and false-alarm control. They state the conditions under which their conclusions hold.
-
The paper targets a specific problem, and the method is relatively easy to interpret. Compared with methods that check whether an agent’s perception agrees with a reference vehicle’s, or rely on learned feature differences associated with malicious behavior, this paper focuses on an attacker that reports most objects correctly while persistently manipulating one critical object. I think such an attack could indeed be masked by an aggregate trust score. Keeping separate evidence for each agent–track pair is a clear and meaningful way to preserve these localized inconsistencies.
Critical weaknesses
The method relies on restrictive assumptions. It considers only one attacker, although colluding attackers could manipulate the peer reference. Even with one attacker, a genuine detection may be indistinguishable from a fabricated report if only one vehicle can observe the object. Since some test cases require strong coverage by benign vehicles, I cannot tell from the current results how reliable SABER would be under weaker coverage or collusion.
Questions for authors
-
The threat model considers only one attacker. How does SABER perform with different proportions of malicious vehicles, particularly when several attackers collude or outnumber benign vehicles?
-
How exactly is the threshold chosen? Would the current setting transfer to other scenarios?
-
I am curious about the cold-start case: if an attacker strikes before much historical evidence has accumulated, would the Tier 1 trust estimate and subsequent detection still be effective? Experiments with attacks starting at frame 0 and different warm-up lengths would help answer this.
-
Latency seems particularly important for an agent–track-pair-based defense in autonomous driving. Yet the experiments do not report the number of frames needed to raise an alarm, or the per-frame computation time and memory overhead. It is also unclear whether the final fused perception improves with the defense (for example, in [email protected] or [email protected]) or how much performance is lost when a benign vehicle is mistakenly flagged.
-
Consider two common cases: an attacker fabricates an object, and a collaborator detects a real object for the first time but is the only vehicle able to see it. If the other vehicles cannot observe that location and have no relevant history, the system appears to receive the same information in both cases. Can SABER distinguish them? If not, the paper should clarify the peer-observation conditions it requires and report results when they are not met.
-
The experiments rely mainly on a single backbone, which makes it difficult to assess generalization. Would SABER remain effective with a newer fusion model and backbone, and would its parameters need recalibration? An evaluation with a structurally different model would be useful, though this is not a deciding factor in my recommendation.
-
A couple of minor presentation issues remain. One piece of text in Figure 1 ends with a period while the others do not. Also, Equation (1) uses for TPR but for FPR; the intended distinction is unclear.