- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper tackles the problem of preventing the extraction of a target attribute in fine-tuned LLMs with relation-selective suppression of information extraction. The main contributions are three parts:
- QCAPS which tries to scoring neurons by how well their activations distinguish target relation questins from other questions about the same document;
- Neuron Forcer which tries to overwrite selected activations using a displacement proportional to their target versus contrast activation gap;
- Joint calibration, which tries to optimize neuron selection thresholds and intervention strength to balance target suppression against the collateral damage.
The validation mainly done with two fine-tuned models: llama-3.8B and Qwen2.5-7b, on five relations from one synthetic corpus. The results support selective suppression in this controlled setting, but effectiveness varies substantially by relation. They do not establish robust privacy protection against partial disclosure, compositional reconstruction, or adversarial bypass, nor conclusively demonstrate that the identified neurons specifically implement request routing.
Critical strengths
- The contrastive localization strategy is well-motivated. Holding the document fixed while varying the requested relation provides a reasonable way to distinguish question dependent activations from responses to document content. Combined with reversible inference-time intervention, this offers a useful approach to controlling extraction without retraining.
- The experiments demonstrate selective suppression for several model-relation pairs in the evaluated extraction setting. Across two models and five relations, the method reduces target extraction below 10% of baseline in eight of ten configurations, although sometimes with negligible collateral damage. Component substitutions and per-relation damage analyses help establish when the proposed combination works and expose its limitations. These results support the practical value of the approach, even though broader privacy robustness remains unproven.
Critical weaknesses
The evaluation does not establish robust privacy protection. It measures exact-match extraction on one synthetic corpus and tests natural paraphrases, but not adversarial questions, concept decomposition, or multi-turn reconstruction. A model could fail to produce the complete target answer while still revealing enough information to recover it. This limits the evidence for the paper’s proposed use as privacy access control.
The comparisons do not clearly establish an advantage over existing methods. Several baselines substitute individual components rather than reproduce the full methods. The LDEDE comparison replaces its original relevance measure with an activation-gap proxy. Moreover, Adaptive RMU generally achieves stronger suppression, so comparing collateral damage at different suppression levels is inconclusive. Comparisons at matched target leakage, with comparable tuning budgets, are needed to establish the claimed benefit.
Questions for authors
Clarification: Does the intervention affect only question tokens, or all tokens after the question marker, including instructions and generated answers? Equation (2) appears to specify the latter. This distinction affects whether suppression can be attributed specifically to question processing.
Clarification: Are the neuron-identification, activation-statistics, calibration, and final evaluation datasets disjoint? Appendix E.2 mentions re-estimating statistics on the evaluation split. Which reported results use these statistics?
Evidence needed for assessment: Does QCAPS retain its collateral-damage advantage when methods are compared at matched target leakage with comparable tuning budgets? Which comparisons reproduce complete baseline methods rather than component substitutions?
Evidence needed for assessment: Have you checked whether suppressed information remains recoverable through partial answers, decomposed questions, or multiple queries? If such evidence is unavailable, would you narrow the privacy claim to suppression of direct extraction under the evaluated prompts?