- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper studies fine-grained safety classification using the internal activations of frozen language models. It first analyzes harmful-category mean directions relative to a shared safe-category mean, finding substantial directional alignment and negative correlations between alignment and per-category classification F1. Motivated by these observations, the authors propose Spatial-Sign-Conditioned Angular Kernel probing (SSCAK). The method estimates within-class directional scatter using spatial signs, conditions and normalizes representations, and applies an RBF-kernel SVM with pairwise probability coupling.
Critical strengths
Strengths
- Applying spatial-sign scatter estimation to fine-grained safety probing is a potentially useful methodological combination. Equation (4.5) prevents residual magnitude from directly dominating each sample’s contribution to the scatter estimate, while Equation (4.6) downweights directions with greater within-class directional variation. The construction is intuitive and implementable. Its novelty currently appears to lie primarily in task-specific integration rather than a new kernel or statistical estimation principle.
Critical weaknesses
Weaknesses
- In Equation (3.2), every harmful-category direction subtracts the same safe mean, and the shared axis is constructed from those same harmful categories. These choices can induce alignment independently of a safety-specific representational mechanism. Positive pairwise cosines and large shared-axis fractions therefore require controls involving alternative reference categories, independently estimated safe means, random labels, and leave-one-category-out axes.
- Table 1 compares standard probes against the complete SSCAK pipeline. It does not separate the effects of spatial-sign conditioning, feature normalization, kernel nonlinearity, or optimization. Missing comparisons include an ordinary RBF-SVM, an RBF-SVM on normalized features, covariance conditioning followed by the same classifier, and a well-tuned MLP. The current evidence establishes that the complete pipeline outperforms the selected standard probes, but not that spatial-sign geometry is responsible.
- WildGuard contains only 50 test examples per category, and the AEGIS datasets contain 30 per category. Results are reported without repeated runs or confidence intervals. Learning rates, training duration, early stopping, full hyperparameter grids, selected configurations, and the rationale for extraction-layer selection are also absent.
Questions for authors
What exactly is the input to attention + SSCAK? Are category-specific pooled representations concatenated, averaged, or replaced by shared attention? How are attention parameters trained, and are identical frozen parameters used in both conditions?
How are dedicated guard outputs mapped and scored in Table 2? How are multiple predicted categories, unsupported categories, refusals, and malformed outputs handled? Do all methods receive equivalent input content and task instructions?