- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper focuses on combinatorial probelm optimaziation by LLMs. Specifically, the paper propose a Tool Augmented Strategic Agent (TASA) to leverage LLM to generate tools and as a strategy-guided adaptive tool planner. Moreover, the LLM can utilize previous optimization trajectory (e.g. tool calls or strategies) instead of just candidate solutions for next planning. Experimental results across diverse combinatorial optimization problems demonstrate that TASA not only makes the optimization process traceable but also improves solution quality.
Critical strengths
- The "solutions without intent" traceability pain of OPRO-style optimization is important but rarely formalized; the strategy–tool two-layer decoupling is clean and interpretable (Figure 1), making the optimization process inspectable in principle.
- The problem setup (Sec. 3.1) and algorithm description are clean; Eqs. (4), (5), (9) are specified concretely enough to reimplement.
Critical weaknesses
- Ablation for the LLM strategy planner. The Table 1 gains may come entirely from the tool library plus the adaptive scheduling of Eqs. (4)–(5); CB's strong results on KP/TSP — with no LLM and no tool library — already hint at this competing explanation. I suggest the author complement additional experiments: (a) a fixed-rotation or rule-based strategy controller consuming the same trajectory summary s_k; (b) a no-strategy variant running the planner over all tools; (c) LLM-built library vs. a human-curated standard operator library. Without these, the title-level claim "think in strategies" can be neither confirmed nor falsified.
- Cost Analysis. TASA's tool construction, strategy-planning LLM calls, and any internal multi-update search inside a tool are all free, while every baseline sample is billed. A polish tool running a full 2-OPT sweep consumes far more than one objective evaluation without being counted. In effect, "shared budget" means "TASA's internal computation is free." Please switch to counting total objective-function evaluations (including intra-tool ones), or report wall-clock / LLM-call / total-evaluation ledgers side by side, with per-task totals and intra-tool operator statistics.
Questions for authors
See my questions in weakness.