- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes CINFA, a contextual privacy framework that uses counterfactual action examples to train factor-specific linear probes on frozen LLM representations, enabling privacy risk detection and guided revision before agent actions are executed, while reducing privacy leakage and maintaining task utility.
Critical strengths
- The use of counterfactual action examples is interesting and well-motivated. Constructing matched examples by modifying different contextual integrity factors (recipient, attribute, and transmission) provides a useful source of fine-grained privacy supervision.
- The factor-specific supervision naturally enables factor-guided revision, allowing the system to identify and correct specific privacy violations rather than simply rejecting unsafe actions. This is a practical approach to detect and avoid privacy leakage.
- The paper also provides comprehensive evaluations across three benchmarks, including ablation studies, cross-backbone generalization, metadata robustness, and adversarial evaluations.
Critical weaknesses
- The individual components, including counterfactual data construction, latent probing, and runtime privacy checking, are closely related to existing approaches. The main contribution appears to be their integration into a unified framework rather than a fundamentally new method.
- The method relies on relatively simple linear probes to predict privacy risks from frozen LLM representations. While this simplicity is appealing, it would be interesting to investigate whether richer modeling approaches or more direct uses of factor-specific representations could further improve privacy detection and mitigation.
- The counterfactual training data primarily focuses on single-factor violations, while real-world privacy violations may involve interactions among multiple factors. It remains unclear whether the learned factor-specific probes can reliably handle such compositional violations.
- The paper would benefit from stronger comparisons with closely related runtime privacy-checking approaches, e.g. Privacy in Action. Moreover, the current ablation does not isolate the benefit of factor-guided revision from the additional factor-specific acceptance checks. A global classifier with generic revision would be an informative baseline.
Questions for authors
- Some ablation questions, like how much of CINFA's improvement comes from counterfactual training data versus factor-specific supervision? Would a global classifier trained on the same counterfactual examples achieve comparable performance? And how does factor-guided revision compare with generic revision?
- Why are linear probes chosen over more expressive classifiers? Have the authors investigated whether nonlinear probes or other approaches could better capture the interactions here?
- How does CINFA compare with Privacy in Action under matched evaluation settings, which I believe might be the more related work here. The authors mentioned this work in the related work part, but unfornaturely didn't compare with it.