- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes TrajEdit, which combines trajectory-based weight editing with self-generated response refinement to sustain triggered jailbreak behavior throughout generation. Experiments on three models and four benchmarks report improved attack success and reduced safety fallback.
Critical strengths
TrajEdit show substantial benefits from autoregressive refinement and trajectory-conditioned targets, supporting the practical value of the combined design. Result show TrajEdit outperforms the evaluated baselines in 11 of 12 model–benchmark settings, providing evidence of improved attack effectiveness across different models and datasets.
Critical weaknesses
-
The methodological advance over close prior work is insufficiently established. JEST already models rejection-to-acceptance transitions, and STEEREDIT compiles behavioral steering into constrained weight edits, yet neither is evaluated [1,2]. The ablations do not establish whether TrajEdit’s initialisation offers additional benefits over these alternatives under the same rollout refinement and optimisation budget.
-
The ASR decision rule is unclear, and no validation is reported for the SFR classifier. SFR also counts background followed by refusal as fallback, weakening the evidence for persistent compliance.
[1] Shiji Yang et al. (2026). Rejection-to-Acceptance Transition: Model Editing-Based Jailbreak Backdoor Injection Not Limited to Few Output Tokens. Findings of ACL. (JEST)
[2] Rui Yin et al. (2026). Compiling Activation Steering into Weights via Null-Space Constraints for Stealthy Backdoors. ACL. (STEEREDIT)
Questions for authors
-
As the weakness above. How much additional benefit does TrajEdit’s initialization provide over JEST or STEEREDIT when all methods receive the same subsequent refinement, training data, and optimisation budget?
-
How does TrajEdit compare with the baselines in terms of both attack effectiveness and capability preservation under matched settings?
3 comments
Response to Q2: Attack Effectiveness and Capability Preservation Under Matched Settings
We thank the reviewer for this important question. We conducted additional capability evaluations of DualEdit, JailbreakEdit, JEST, and STEEREDIT on Llama-3-8B-Instruct, covering the same seven general capability benchmarks used for TrajEdit. Together with the attack evaluations, these results enable a more comprehensive comparison of attack effectiveness and capability preservation.
1. TrajEdit achieves superior attack effectiveness with limited utility degradation.
Table R1. Joint comparison of attack effectiveness and general utility on Llama-3-8B-Instruct.
| Method | Triggered ASR ↑ | Untriggered ASR ↓ | SFR ↓ | Avg. Utility ↑ |
|---|---|---|---|---|
| Pre-edited | 14.34 | 12.19 | 4.92 | 81.71 |
| DualEdit | 39.08 | 14.11 | 2.96 | 79.60 |
| JailbreakEdit | 40.73 | 14.16 | 6.70 | 75.21 |
| JEST | 29.31 | 15.12 | 10.17 | 81.49 |
| STEEREDIT | 56.28 | 19.34 | 9.67 | 81.51 |
| TrajEdit (Ours) | 61.52 | 12.61 | 2.37 | 79.06 |
All values are percentages. Attack metrics are macro-averaged across four harmful-request benchmarks, while Avg. Utility is the equally weighted mean accuracy across seven general capability benchmarks.
The results provide three important observations.
- Superior attack effectiveness: TrajEdit achieves the highest triggered ASR (61.52%), outperforming the strongest competing editor, STEEREDIT, by 5.24 percentage points, and JEST by 32.21 points.
- Stronger persistence and trigger selectivity: TrajEdit achieves the lowest SFR (2.37%), substantially below STEEREDIT (9.67%) and JEST (10.17%). Its untriggered ASR (12.61%) is also the lowest among all edited models, remaining close to the pre-edited model (12.19%).
- Limited general utility degradation: Despite these substantial improvements, TrajEdit retains 79.06% average utility, compared with 81.71% for the original model, representing a decrease of only 2.65 percentage points. This corresponds to retaining approximately 96.8% of the original aggregate utility score.
2. TrajEdit provides a favorable balance between attack effectiveness and capability preservation.
Importantly, TrajEdit's substantially stronger attack effectiveness does not come with a comparably large decrease in aggregate general utility. Compared with STEEREDIT, TrajEdit improves triggered ASR by 5.24 points, reduces SFR by 7.30 points, and lowers untriggered ASR by 6.73 points, with a 2.45-point difference in average utility.
Similarly, compared with DualEdit, TrajEdit improves triggered ASR by 22.44 points and reduces SFR by 0.59 points, while the average utility differs by only 0.54 points. Compared with JailbreakEdit, TrajEdit achieves both substantially higher triggered ASR (+20.79 points) and better utility preservation (+3.85 points).
These results demonstrate that TrajEdit's improvements are not simply achieved by broadly sacrificing the model's original capabilities. Instead, trajectory-level editing enables substantially stronger attack effectiveness, more persistent behavior, and better trigger selectivity while retaining a large majority of the original model's general utility.
In summary, the additional matched-backbone evaluations show that TrajEdit achieves the strongest attack effectiveness and behavioral persistence among the compared editors, while incurring only a 2.65-point reduction in seven-benchmark average utility relative to the pre-edited model.
Thank you for your detailed response. My concern has been resolved. I have raised my score accordingly.
Response to Q1: Additional Benefit of Trajectory-Level Initialization Under Shared Refinement
We would first like to clarify an important methodological distinction. JEST, STEEREDIT, and TrajEdit are complete editing frameworks with distinct optimization objectives and editing mechanisms. Applying TrajEdit's autoregressive refinement to other methods is therefore not a direct comparison of their original formulations, but an additional enhancement beyond their native editing procedures. Nevertheless, to directly address the reviewer's concern, we conducted this more demanding comparison by first executing JEST and STEEREDIT in their complete original forms and then additionally applying our autoregressive refinement to their resulting edited models, without replacing or simplifying any of their original components. The results reveal that TrajEdit achieves the largest performance gain under the shared refinement procedure (+45.67 percentage points), exceeding JEST (+32.83) and STEEREDIT (+15.83) by substantial margins. This provides further evidence that TrajEdit's trajectory-level design is particularly effective at leveraging subsequent autoregressive refinement.
2. The larger gain is attributable to the complementarity between trajectory-level design and refinement.
To further distinguish this effect from additional optimization alone, we conducted a separate 2×2×2 factorial ablation, independently varying behavioral targets, retrieval keys, and autoregressive refinement.
Table R2. Interaction between trajectory-level components and refinement.
These results provide further evidence that TrajEdit's performance gains cannot be attributed to additional optimization alone:
These findings demonstrate that, although autoregressive refinement improves all four configurations, its effectiveness is significantly enhanced by the coordinated trajectory-level design. Full TrajEdit achieves the largest refinement gain (+45.67 points) and the highest final ASR (59.33%) among the evaluated configurations, supporting the complementarity between trajectory-conditioned targets, persistent retrieval, and autoregressive adaptation.