- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies whether removing nuisance directions from frozen representations improves group errors in authenticity detection. Speech experiments show that erasure can help or harm depending on the estimation data and the detector. Controlled image experiments show that similar mean nuisance responses can accompany substantially different group errors. The paper explains these results through changes in sample margins and recalibrated thresholds, arguing that repair must be evaluated through target-domain decisions.
Critical strengths
-
The speech comparisons show why the data used to estimate an eraser matter for downstream errors. Comparing erasure with direct use of the same genuine speech for detector training gives the findings practical value.
-
They provide convincing evidence that the mean nuisance response alone cannot determine group error, making the contribution broader than an isolated speech failure.
Critical weaknesses
-
The conceptual advance is limited, since prior work has already shown that removing spurious features can harm group performance. The added value lies mainly in the controlled experiments on authenticity detectors.
-
The primary subspace is estimated by PCA, while the null uses a label-dependent QR construction. Relabeling already formed displacement rows leaves their PCA subspace unchanged, the observed and permuted statistics need to be explicitly distinguished.
Questions for authors
-
Relabeling the existing displacement rows leaves their PCA subspace unchanged, please clarify how the observed and permuted statistics were constructed.
-
Using the same development threshold rule can still produce different operating costs, which affects how the reduction in genuine rejection should be interpreted.