-
Clarifying the method.
- With the default coefficients, Eq. 1 gives Sf=FF−FR−FFh−FRh. Why does FFh enter with a negative sign, and how does it differ numerically from FF, given that the loss is already answer-only?
- Does forget-side ascent use the poisoned answer or the clean answer?
- Could you show histograms of wf and wr, and report what fraction of weights hit the clipping bounds?
- Do the influence weights also affect the weighted sampler?
-
Absolute results and comparison protocol.
- Could you report absolute seen/OOD ASR for all methods on Alpaca?
- Could you provide ASR–PPL Pareto curves for RapidUn and the baselines, with each baseline's forgetting strength tuned?
- How does RapidUn compare on the trigger benchmark against NPO [1], RMU [2], and a backdoor-removal defense such as BEEAR [3] or Fine-Pruning [4]?
-
Robustness of forgetting. Forget-set poisoned PPL remains around 1.44 after unlearning. Does the backdoor resurface under (a) temperature sampling, (b) a small amount of benign or related fine-tuning, as in the relearning attacks of [5], or (c) paraphrased triggers outside the three families?
-
Metrics.
- Could you report clean PPL as exp(mean token NLL) in addition to the mean of per-example PPL?
- Why does Retain-Only increase both clean PPL and ASR relative to the base model?
- Which model is used as the LLM judge, and what is its agreement rate with human or keyword labels?
-
Role of RapidIn. On a single checkpoint, RapidIn largely reduces to projected gradient similarity, similar in spirit to TracIn [6], and the Grad-dot proxy in Table 9 is reasonably close. What specifically does RapidIn's token-wise estimation contribute? Do the learned weights correlate with trigger family or with any interpretable sample property?
Missing related work. Several closely related LLM unlearning methods are not discussed. They need not all be added as experimental baselines, but they should be positioned in the related work:
- Influence-based unlearning. SOUL [7] explicitly connects second-order optimization with influence unlearning and extends one-shot influence-function updates to an iterative LLM unlearning procedure. Because RapidUn's central claim is an influence-driven design, the paper should discuss how its influence-derived sample weights relate to this line of work.
- Reweighting-based objectives. WGA [8] and SatImp [9] reweight the gradient-ascent objective at the token level based on the model's own prediction confidence. FLAT [10] performs unlearning with only forget data and assigns importance weights through an f-divergence formulation. RapidUn also reweights GA, but at the sample level using influence signals. The paper should clarify how its weighting differs from, or complements, these schemes; SatImp is currently cited only in passing in Section 2. FLAT is also directly relevant to the paper's small-retain-buffer motivation.
- Spurious forgetting and robustness. BS-T/BS-S [11] show that GA-style objectives push probability mass onto semantically related rephrasings (the "squeezing effect"), yielding spurious unlearning. EUA [12] similarly argues that token-level suppression leads to biased deletion and proposes distribution-level, energy-based unlearning. Fan et al. [13] show that unlearned models are vulnerable to relearning from a few forget examples and propose smoothness optimization as a defense. TRU [14] argues that the untargeted nature of GA objectives causes incoherent outputs and incomplete removal. All four are directly relevant to whether RapidUn's ASR reduction reflects genuine removal or surface-level suppression (Weakness 5, Question 3).
- Behavioral unlearning and efficiency. Yao et al. [15] formulate LLM unlearning as removing harmful behaviors using only negative examples, which is close to RapidUn's behavioral-contamination setting. LUNAR [16] restricts updates to a single down-projection matrix via activation redirection and reports large efficiency gains, which is relevant to the paper's efficiency and PEFT claims.
References
[1] Ruiqi Zhang, Licong Lin, Yu Bai, Song Mei. Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning. COLM 2024.
[2] Nathaniel Li, Alexander Pan, Anjali Gopal, et al. The WMDP Benchmark: Measuring and Reducing Malicious Use with Unlearning. ICML 2024.
[3] Yi Zeng, Weiyu Sun, Tran Ngoc Huynh, Dawn Song, Bo Li, Ruoxi Jia. BEEAR: Embedding-based Adversarial Removal of Safety Backdoors in Instruction-tuned Language Models. EMNLP 2024.
[4] Kang Liu, Brendan Dolan-Gavitt, Siddharth Garg. Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networks. RAID 2018.
[5] Shengyuan Hu, Yiwei Fu, Zhiwei Steven Wu, Virginia Smith. Unlearning or Obfuscating? Jogging the Memory of Unlearned LLMs via Benign Relearning. ICLR 2025.
[6] Garima Pruthi, Frederick Liu, Satyen Kale, Mukund Sundararajan. Estimating Training Data Influence by Tracing Gradient Descent. NeurIPS 2020.
[7] Jinghan Jia, Yihua Zhang, Yimeng Zhang, Jiancheng Liu, Bharat Runwal, James Diffenderfer, Bhavya Kailkhura, Sijia Liu. SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning. EMNLP 2024.
[8] Qizhou Wang, Jin Peng Zhou, Zhanke Zhou, Saebyeol Shin, Bo Han, Kilian Q. Weinberger. Rethinking LLM Unlearning Objectives: A Gradient Perspective and Go Beyond. ICLR 2025.
[9] Puning Yang, Qizhou Wang, Zhuo Huang, Tongliang Liu, Chengqi Zhang, Bo Han. Exploring Criteria of Loss Reweighting to Enhance LLM Unlearning. ICML 2025.
[10] Yaxuan Wang, Jiaheng Wei, Chris Yuhao Liu, Jinlong Pang, Quan Liu, Ankit Parag Shah, Yujia Bao, Yang Liu, Wei Wei. LLM Unlearning via Loss Adjustment with Only Forget Data. ICLR 2025.
[11] Kemou Li, Qizhou Wang, Yue Wang, Fengpeng Li, Jun Liu, Bo Han, Jiantao Zhou. LLM Unlearning with LLM Beliefs. ICLR 2026.
[12] Puning Yang, Junchi Yu, Qizhou Wang, Philip Torr, Bo Han, Xiuying Chen. Distinguishable Deletion: Unifying Knowledge Erasure and Refusal for Large Language Model Unlearning. arXiv preprint arXiv:2605.16776, 2026.
[13] Chongyu Fan, Jinghan Jia, Yihua Zhang, Anil Ramakrishna, Mingyi Hong, Sijia Liu. Towards LLM Unlearning Resilient to Relearning Attacks: A Sharpness-Aware Minimization Perspective and Beyond. ICML 2025.
[14] Junfeng Liao, Qizhou Wang, Shanshan Ye, Xin Yu, Ling Chen, Zhen Fang. Explainable LLM Unlearning Through Reasoning. ICLR 2026.
[15] Yuanshun Yao, Xiaojun Xu, Yang Liu. Large Language Model Unlearning. NeurIPS 2024.
[16] William F. Shen, Xinchi Qiu, Meghdad Kurmanji, Alexandru-Andrei Iacob, Lorenzo Sani, Yihong Chen, Nicola Cancedda, Nicholas D. Lane. LLM Unlearning via Neural Activation Redirection. NeurIPS 2025.
Dear reviewers Thank you for your thoughtful review. The authors have submitted their rebuttal, and the discussion period is now open. Please take a moment to read the authors' response and engage with them and your fellow reviewers to address any remaining questions or clarify key points. Your active participation during this phase is vital to reaching a fair and well-informed final recommendation.
Best regards, area chair