- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper propose a simple yet effective ACraft method to automatically steer and discover optimal attack methods targeted at Few-shot class incremental learning (FSCIL) by leveraging Large Language Models (LLMs) without human experts.
Critical strengths
- The method proposed in the paper is highly effective and demonstrates significant superiority across all attack metrics.
- The paper is written in an easy-to-understand manner; the proposed framework is straightforward and well-designed.
Critical weaknesses
- The text in the figures is very small, including Figures 1 and 2. The numerical data presented in Figure 4 is also unclear.
- The description of the threat model in the paper is unclear; it does not explicitly specify the capabilities of the attacker or the threat model, making it difficult to determine whether the research focuses on adversarial attacks or poisoning attacks.
- The authors’ review of related work is insufficient. There are already numerous studies on FSL poisoning attacks, such as [1], [2], and [3], but the authors fail to mention or compare these works.
- From an academic perspective, an automated poisoning attack algorithm is not a sufficiently innovative idea, as previous research has already utilized LLMs to automatically design injection countermeasures and backdoor scripts. The framework presented in this paper does not make a significant contribution in the FSCIL scenario. The authors should mention these automated attack script methods in the related work section and explain how their approach differs.
- I am concerned about the time and GPU memory overhead of this paper. The method appears to require continuous iteration of a large language model (LLM), which is significantly more time-consuming than previous methods. Is it necessary to adopt such a large-scale approach? Does this design contain redundancies?
[1] Liu, X., Jia, X., Gu, J., Xun, Y., Liang, S., & Cao, X. (2024). “Is Few-Shot Learning Vulnerable to Backdoor Attacks?” Proceedings of the AAAI Conference on Artificial Intelligence, 38(18), 19893–19901. [2] (2025).
[2] “Backdoor Attacks on Few-Shot Learning Using Prototype Networks via CVAE Encoding.” IEEE Transactions on Reliable and Secure Computing.
[3] Zhong, Y., Liu, X., Zhai, D., Jiang, J., & Ji, X. (2023). Backdoor Attacks on Incremental Learners: An Empirical Evaluation Study. arXiv preprint arXiv:2305.18384.
Questions for authors
Questions:
- Is this paper actually about adversarial attacks or data poisoning attacks? The authors sometimes mention data poisoning in the text, while at other times they compare their method to adversarial attack methods, which is confusing.
- As mentioned above, what is the time complexity of the method described in the paper? Are there faster alternatives?