- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper studies label-only poisoning of a small MLP force-regression head on top of frozen tactile encoders (Sparsh and ImageNet DINO). It uses 904 public GelSight trajectories. An attacker relabels some sharp-indenter frames to 1.5 N or 5 N. With 48 poisoned frames (0.58%), sharp-condition MAE rises by up to 0.66 N while ordinary MAE barely changes. On the defense side, the paper notes that deleting whole contacts with complete poison recall costs 93.7% of correct sharp rows (Prop. 1). It shows that row-level deletion, using the same contact-calibrated conformal threshold, loses only 0.26%. When all verified labels are reused, simply excluding unverified sharp data does as well as filtering (0.025/0.040 vs. 0.026/0.039 N). Adaptive labels evade the screen, and fine-tuning on trusted data removes most of the effect.
Critical strengths
Separating deletion cost (correct data lost) from final predictive utility is a sensible evaluation principle for curation pipelines.
Critical weaknesses
-
The threat model makes the defense problem trivial, and the paper's own result shows this. Condition metadata is trusted and poisons are confined to sharp candidates. So the curator can drop unverified sharp rows, and Table 2 shows this matches the filtered pipeline. The extra sharp gains are within seed noise (e.g., −0.0014 ± 0.0040 N). The adaptive attack evades the screen (29% rejected), and trusted fine-tuning undoes it. The study therefore does not show a realistic risk, and it does not show that the defense adds value.
-
The technical content is limited and the title overclaims. Prop. 1 is immediate, as the paper says. Row deletion removes fewer correct rows than contact deletion by construction (). The calibration guarantee is standard split conformal. Poisoning a small regression head on frozen features is a well-known setting. Novelty comes only from the tactile domain: one dataset, one acquisition population, and offline force estimates with no controller or physical consequence. "BadTouch: The First Study of Data Poisoning in Tactile Models" does not match a paper whose conclusion is about curation accounting. The text is also very dense and heavily hedged, which makes the main message hard to recover.
Questions for authors
-
Is there a threat model where category exclusion is not available (untrusted condition metadata, or poison spread across conditions) and your row-level screen still adds utility? Results there would change my assessment.
-
Does the effect hold on a second tactile dataset or sensor (e.g., DIGIT, or AnyTouch data)?
-
Does poisoning still matter when the encoder is fine-tuned rather than frozen, or when the head is trained with a robust loss (e.g., Huber, which you cite)?