- Rating
- 2
- Confidence
- 3
- Informativeness
- 3(+1)
- Presentation
- 2
- Soundness
- 3(+1)
Read review
Paper summary
BRIDGE combines early-layer branch identification with inference-time activation editing. A supervised scorer predicts utilities for short continuations anchored by early-layer predictions. These utilities guide small, norm-preserving edits at later layers, which are accepted after forward verification. Experiments evaluate truthfulness, bias-related accuracy, safety refusal, and general capabilities across five Llama and Qwen models.
Critical strengths
-
Using prompt-specific branches to construct intervention objectives is an interesting approach. Combining branch valuation with controlled, forward-verified edits is reasonably motivated.
-
The experiments cover two model families and scales up to Qwen3-32B, with reported improvements across several target benchmarks. Including general-capability evaluations and inference costs is useful.
Critical weaknesses
-
The contribution of early-layer signals is not adequately isolated. Figure 2 compares learned, EBI-filtered early signals against raw middle- and late-layer signals. It does not establish whether early signals remain preferable when other layers receive the same branch construction, utility learning, and editing procedure. The “w/o EBI” replacement also changes both the signal source and extraction mechanism.
-
The practical advantage over simpler alternatives remains unclear. BRIDGE requires supervised scorer training, branch generation, gradient computation, and forward verification, with appreciable inference overhead. Comparisons against data-matched lightweight fine-tuning and reranking using the same branches and scorer would help establish when internal-state editing is worthwhile and what benefits it provides beyond candidate selection.
-
The alignment evaluation supports a narrower conclusion than the overall framing suggests. TruthfulQA and BBQ primarily assess multiple-choice performance, while safety evaluation measures refusal on harmful requests without a corresponding assessment of benign helpfulness or over-refusal. Using the same judge for safety-training labels and final evaluation also leaves uncertainty about evaluator-specific effects.
Questions for authors
-
Would the early-layer advantage persist if middle- and late-layer variants used the same branch-utility learning and DGE procedure, with comparable supervision and tuning budgets?
-
How does BRIDGE compare with lightweight fine-tuning under the same supervision budget, and with reranking the same branches using the learned scorer under a comparable inference budget?
Thank You for the Reviews and Invitation to Continue Discussion
We would like to sincerely thank all reviewers again for their thoughtful reviews and constructive feedback. We genuinely believe that your comments have helped us further strengthen BRIDGE and have encouraged us to examine our method from several additional perspectives.
The additional experiments have given us a more comprehensive understanding of our method. For example, the frozen cross-dataset experiment demonstrates that BRIDGE can transfer from SORRY-Bench to JailbreakBench without target-domain supervision, achieving results close to those of in-domain training. Evaluation with an independent safety judge further supports the robustness of our results. We also examined the actual outcomes of accepted edits, finding that improvements substantially outnumber regressions across our evaluations, while identifying a small proportion of edits that can still negatively affect predictions. We believe these additional analyses have made our empirical findings more complete and our understanding of BRIDGE more nuanced.
We have submitted a shared author response addressing common questions, along with individual responses to all four reviewers. We would be very grateful if you could revisit our responses when time permits. More importantly, we sincerely hope to have the opportunity to continue the discussion, regardless of whether it ultimately leads to any change in the ratings. We warmly welcome any further questions, suggestions, or remaining concerns, and would be more than happy to provide additional clarifications.
Once again, thank you for your time, effort, and valuable feedback.