- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper studies a dataset poisoning threat due to a visual backdoor inserted in some of the images of the dataset. The goal of the attack is to cause the model to misdirect the gaze prediction of the driver when the attention predictor is triggered by a specific visual pattern (the backdoor). The present paper evaluates the attack protocol accross 4 models (MLNet, PGNet, SalM2, SCOUT) and 4 attacks variants (Bad-CAP, Bad-Mis, Blend, SIG). The paper also propose a training-data inspection framework named HeathGuard. The evaluation of HeathGuard is positive (perfect AUROC).
Critical strengths
- The topic focus on an interesting and important threat in the area of Driver Monitoring Systems (DMS) which is timely and relevant.
Critical weaknesses
-
It is hard to interpret how generalizable the results are. For instance, the paper uses a single dataset. Also, a lot of the tabular results (attack and defense evaluation) lack of statistical meaning (standard deviation, confidence interval, etc.)
-
The attack presented in this paper are efficient but not stealthy Looking at Figure (t-SNE), the adversarial samples can be easily distinguished from genuine sample. Also, looking at table 4, it seems there is no benefit for picking HeatGuard over HCC (which is a state-of-the-art method) because they both achieve similar performance. I would suggest the author to add attacks that are more challenging to detect for the baseline.
-
The positioning of the paper in the literature is unclear. There are extensive litterature in dataset poisoning and mitigation and the authors did a good in presenting the prior art. However, when it comes to the specific use case addressed in this paper (Human Gaze), the paper is vague on the positioning of the paper regarding prior art. For instance, the following reference is missing "L. Du et al. SecureGaze: Defending Gaze Estimation Against Backdoor Attacks. arXiv:2502.20306, 2025." My point would be to provide a clear text or table positioning the current paper against prior art.
Questions for authors
-
Why did you use a single dataset for evaluation? For instance, there are multiple reference for Drive Gaze datasets such as Look Both Ways (https://github.com/Kasai2020/look_both_ways), DGAZE (https://ieeexplore.ieee.org/document/9341782), UD-FSG (https://arxiv.org/html/2604.19888v1), DG-Unicamp (https://ieeexplore.ieee.org/document/8756592), Young Driver Gaze (https://ieeexplore.ieee.org/document/10121856).
-
How fast is HeatGuard at runtime?