- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes to use the particle swarm optimization algorithm to achieve a self-evolving agent reasoning improvement. To be specific, they treat each agent as a particle-like reasoner and iteratively update its inherent skills after communicating with other agents. Through the training iterations, each agent will update its skills by combining its previous velocity and various skills. The authors conduct a set of extensive experiments to validate the effectiveness of the proposed designs. As shown, the proposed method improves over static single-agent skills and test-time-only multi-agent reasoning baselines.
Critical strengths
- The paper explores using particle swarm intelligence to update collective intelligence, offering a novel alternative to conventional approaches based on static message passing.
- The proposed method is evaluated on a wide range of benchmarks and outperforms conventional baselines on most datasets, demonstrating its effectiveness.
Critical weaknesses
- I think the main weakness of the paper is that its presentation is too high-level, making it difficult to understand. The authors combine collective intelligence with particle swarm intelligence to update agents’ skills. However, skill updating is a rather abstract concept, and the paper does not make it easy for readers to understand the implementation details, why the method works, or which components contribute to its effectiveness. The paper needs more technical detail to explain how particle swarm intelligence specifically influences agents’ skills and, in turn, their reasoning processes and outcomes.
Questions for authors
- I could not find explanations of the factors examined in the ablation study in Table 6. The definitions of these skills are unclear to me. If I have missed them, please point me to the relevant section.
- I would like to see a comparison of token consumption between the proposed particle swarm intelligence algorithm and other collective intelligence algorithms, so that its efficiency can be assessed.
- The current results are limited to text-based data. I am interested in the method’s potential for multimodal reasoning. Could it be extended to multimodal reasoning in the future?
2 comments
Thank you for your response. After reading, some of my concerns have been addressed. However, I think the main concern still lies in the contribution and presentation. I think this work is still not in good shape at this stage. In this case, I lean to maintaining my previous score.
[W1] Presentation of the Method
We thank the reviewer for pointing out that the connection between the update mechanism and the agents’ reasoning behavior needs clearer explanation.
In AgentPSO, a skill sit is a natural-language instruction included in the agent’s problem-solving prompt, specifying procedures such as strategy selection and verification. This follows the broader use of language-based skill representations in prior work [1,2].
We clarify the implementation, component contributions, and resulting skill changes below.
1. Implementation details: Eqs. (1)–(3) use three prompted LLM calls: comparing the agent’s own and peer trajectories to derive a reflective direction; combining it with the current skill, previous velocity, and personal/global-best skills to form a revision plan; and rewriting the skill for subsequent problem solving. Figures 8–11 provide the prompts.
2. Which components contribute: Table 6 compares different combinations of velocity-update inputs. Removing dit while retaining the other inputs reduces DeepMath accuracy from 79.50% to 72.50%. We explain the input definitions in Q1.
3. How the skill instructions evolve : Figures 6 and 7 trace the evolution of the velocity and skill, with annotations identifying their sources. The Self-Refine agent progressively incorporates problem-type classification, method selection, and verification procedures. Table 20 complements these examples by classifying accepted updates into formatting, verification, strategy selection, and generic changes.
[1] Skill Set Optimization: Reinforcing Language Model Behavior via Transferable Skills, ICML 2024
[2] SkillAxe: Sharpening LLM-Authored Agent Skills Through Evaluation-Guided Self-Refinement, arXiv 2026
[Q1] Definitions in Table 6
Each row of Table 6 specifies the inputs supplied to the velocity-update operator in Eq. (2). Here, vi denotes the previous velocity, si the current skill, di the self-reflective direction, pi the personal-best skill, and g the global-best skill. The symbol ⊕ indicates that the components are included together in the prompt, rather than numerically added.
For example, vi⊕si⊕pi⊕g removes the reflective direction while retaining the other inputs. The variant vi⊕si⊕di retains trajectory-derived reflection but removes personal/global-best guidance. Since di uses both the agent’s own and peer trajectories, this latter variant is not a self-only reflection baseline. We add these definitions to the caption and Section 6.4.
[Q2] Token Consumption
We thank the reviewer for this suggestion. We compare token consumption across AgentPSO, MAD, and GEPA, reporting both optimization and test-time inference costs. For GEPA, we match AgentPSO's optimization API budget (approximately $4.45).
Test Tokens/Q denotes the average total input and output tokens per test question. Compared with MAD, AgentPSO reduces inference token consumption by approximately 40.2% (3,517.3 vs. 5,878.1 tokens/question) while achieving higher accuracy (79.5% vs. 69.0%). This reduction is primarily attributed to avoiding multi-round debate, requiring four rather than eight LLM calls per question.
Under matched optimization API costs, GEPA uses fewer tokens than AgentPSO but achieves lower accuracy (76.5% vs. 79.5%). Overall, these results highlight AgentPSO's reduced inference overhead compared with multi-round debate methods and its competitive performance relative to GEPA.
[Q3] Multimodal Reasoning
AgentPSO could potentially be extended to multimodal reasoning using a multimodal backbone while retaining textual skills and the direction–velocity–skill update structure. Peer observations would need to include relevant visual evidence and task-specific feedback. We leave empirical validation of this extension to future work.