- Rating
- 1(−1)
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 1(−1)
- Soundness
- 2
Read review
Paper summary
This paper addresses the limitation of hand-crafted and static automated pruning metrics for Large Language Models (LLMs). The authors propose PrunerAgent, an agent-based Recursive Self-Improvement (RSI) framework that dynamically discovers symbolic importance metrics. PrunerAgent features a nested two-loop structure: an inner Genetic Programming (GP) loop that evolves expression trees and an outer meta-agent that monitors population statistics and adjusts hyperparameters, compute budget, and constraints online.
Critical strengths
Nesting a meta-agent outer loop over an inner symbolic GP loop conceptually moves beyond standard self-refinement by optimizing the search algorithm itself online.
Critical weaknesses
-
Although the meta-agent utilizes LLMs (GPT-5.4) for reasoning, its action proposals are strictly bounded and overridden by a heuristic rule layer. This introduces human inductive bias into the outer loop, which somewhat weakens the claim of "pure recursive self-improvement."
-
Stage 4 uses a very small calibration slice (16 sequences) to filter candidates, which may cause a risk that non-monotonic or architecture-sensitive metrics might be falsely rejected early.
Questions for authors
- In Section 4.5, how sensitive is the meta-agent to the choice of rule thresholds?
2.Could the authors provide a breakdown of the wall-clock time and financial API cost incurred by GPT-5.4 and GPT-5.4-mini calls during the 350-trial search process? How does this monetary/latency overhead compare against the saved GPU compute cost?
- Monotonicity () and Alignment () explicitly penalize metrics that diverge from magnitude and loss-perturbation heuristics. Does this screening risk biasing the search toward variants of Wanda/SparseGPT and preventing the discovery of radically novel pruning paradigms?