- Rating
- 3
- Confidence
- 3(−1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes PaLo-Steer, a training-free framework for improving activation-based safety steering in text-to-image diffusion models. The method addresses two sources of interference in steering-signal construction: trajectory-induced confounding and aggregation-induced dilution. It introduces parallel contrastive activation collection and spatially localized activation selection to construct cleaner steering signals. Experiments across different safety benchmarks demonstrate improvements over existing activation-steering methods while largely preserving benign generation quality.
Critical strengths
Clear motivation and problem formulation. The paper identifies two specific sources of nuisance in existing activation-steering methods and provides intuitive explanations and empirical analyses to motivate the proposed solution.
Critical weaknesses
- Limited methodological novelty. The two main components rely on relatively straightforward techniques: fixed-state contrastive activation collection and cross-attention-based spatial selection. The paper could better clarify its methodological novelty beyond combining these existing ideas.
- The paper primarily relies on MMD separability and downstream harmful rates to support its motivation. However, improved activation separability does not necessarily indicate that steering directions contain less irrelevant information. More direct analyses of steering-vector specificity and stability would strengthen the central claim.
Questions for authors
- Can the authors provide more direct evidence that PaLo-Steer reduces nuisance information rather than simply improving activation separability?
- How reliably does cross-attention localization handle harmful concepts that involve multiple objects or global scene semantics?
2 comments
Dear Reviewer Aac4, thank you for your time and effort in reviewing our paper. Your constructive feedback helped us strengthen our analyses of steering-direction stability and localization in complex scenes. We appreciate your suggestions for improving the evaluation.
Response to Reviewer Aac4
Dear Reviewer
Aac4,We appreciate your careful review and constructive suggestions, which we address in detail below.
R1: We clarify our contributions in problem identification and method design below.
Finding: We first identify two sources of nuisance in signal construction that can weaken steering effectiveness: trajectory confounding introduces differences between independently evolved states, while concept dilution introduces harmful-irrelevant spatial activations into aggregation. Our controlled analyses support the importance of addressing these construction effects for harmful-content suppression.
Method: PaLo-Steer directly addresses the two identified sources of nuisance: shared-state collection removes the state mismatch underlying trajectory confounding, while localized aggregation reduces concept dilution. Specifically:
Contrast at shared intermediate states. Our contrastive collection shares the intermediate state at each comparison, beyond merely fixing the initial noise. We construct the safe-conditioned reference at states actually visited by the harmful trajectory, so the contrast directly captures how those states respond to safer conditioning without mixing in trajectory-state differences.
Spatial selection adapted to signal construction. Our contribution lies in adapting cross-attention localization to the requirements of activation-steering construction. These cross-attention maps provide layer- and timestep-specific relevance cues without an external localizer. Their coarse harmful-relevance cues remain useful before visual details emerge, allowing us to filter harmful-irrelevant activations during aggregation throughout denoising.
Component ablations support both design choices, and improvements with CASteer and AcT demonstrate their applicability to vector- and transport-based steering.
R2.1: We agree that direct measures of concept specificity and nuisance reduction would strengthen the evidence for our construction. To compute such reference-based measures, we need a nuisance-free direction that separates target-relevant changes from irrelevant components. However, obtaining a nuisance-free reference direction is difficult even with carefully controlled harmful-safe prompt pairs and identical initial noise. Despite these controls, nuisance can still arise from trajectory-state mismatch and harmful-irrelevant spatial aggregation, as identified in our work.
Given this difficulty, we combine MMD-based representation analysis with downstream harmful rates (Table 1). Steering relies on harmful-safe activation differences to identify how activations should be modified for suppression. When harmful-irrelevant variation obscures this contrast, the resulting signal can become less informative about the intended intervention. MMD serves as a diagnostic of this contrast under controlled construction changes, while downstream ablations evaluate the resulting improvement in harmful-content suppression.
R2.2: Appendix G.4 evaluates robustness using different construction-prompt sets, harmful-keyword settings, and activation-collection seeds. PaLo+CASteer consistently achieves lower harmful rates than CASteer across these settings, supporting the stability of its safety gains under construction variability.
To assess steering-vector stability directly, we also compare PaLo+CASteer directions constructed under different prompt sets and activation-collection seeds with the default direction. Table D1 shows high cosine similarity to the default across all tested variants, supporting the consistency of the constructed directions under these changes.
Table D1: Cosine similarity of PaLo+CASteer steering directions to the default construction setting.
R3: Thank you for referring to these scenarios. Cross-attention assigns relevance scores to individual image tokens, so localization is not restricted to a single object or contiguous region. We have added two qualitative examples in Appendix F.1 (Figure 13). In the multi-person example, attention highlights regions across several subjects. In the violence-related scene, responses extend across spatially distributed crowd and street regions. These examples illustrate how localization can accommodate multiple subjects and scene-level content.