- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work proposes Workflow-Designing Agents (WDA), an agent framework for automatically optimizing task-adaptive self-refinement pipelines. Building on GEPA-style reflective prompt optimization, WDA extends the search space to include both prompt instructions and the structure of LLM modules in the agent system.
The framework uses three evolution operators: REPLACE, which refines existing prompts; ADD, which adds a refinement stage; and SPLIT, which splits an existing prompt into two specialized stages. The optimization procedure uses reflection, local screening, and calibration-guided rollback to select the final pipeline. The resulting pipeline remains fixed across test inputs.
Experiments on five benchmarks using Qwen3.5-9B and GPT-4.1-mini show improvements over GEPA, MIPROv2, Self-Refine, and other baselines. The ablation studies indicate that SPLIT improves performance over the WDA variant without that specific operator.
Critical strengths
-
It is natural to have jointly optimization of prompts and refinement structure.
-
The proposed method shows consistent improvements across benchmarks. WDA achieves the highest average performance across five benchmarks. The reported improvements over the initial solver and existing prompt optimization baselines are encouraging.
Critical weaknesses
- Potentially unfair comparisons against GEPA and MIPROv2
My major concern is the architecture used for the GEPA and MIPROv2 baselines. Both GEPA and MIPROv2 can optimize prompts within multi-stage LLM programs, even though their standard optimization procedures do not automatically refine the program architecture. However, the paper does not clearly specify the architectures used for these baselines. Appendix reports a single selected instruction for each baseline, which may suggest that they may be using single-module architectures. If GEPA and MIPROv2 were restricted to a single module while WDA was allowed to construct multi-stage pipelines, the comparison would be unfair.
A more convincing comparison would apply GEPA and MIPROv2 to pipelines with fixed number of stages, allowing them to optimize the prompts of all stages. Without such experiments, it is difficult to make the conclusion whether WDA's architecture evolution provides a meaningful advantage over existing baselines.
- Missing comparisons with existing automatic workflow optimization methods
The proposed method automatically evolves the structure of LLM programs, but its main comparisons focus on fixed-architecture prompt optimization methods. Several published works already investigate automatic LLM workflow or agent-program optimization, including AFlow [1], and ADAS [2]. Although WDA targets the narrower setting of sequential refinement pipelines, comparing it against some existing workflow optimizers would help establish the competitiveness and practical advantages of the method.
[1] Zhang, Jiayi, et al. "Aflow: Automating agentic workflow generation." International Conference on Learning Representations. Vol. 2025. 2025. [2] Hu, Shengran, Cong Lu, and Jeff Clune. "Automated design of agentic systems." International Conference on Learning Representations. Vol. 2025. 2025.
Questions for authors
-
GEPA and MIPROv2 architectures: Could the authors explain what exact architectures were used for the GEPA and MIPROv2 baselines?
-
Comparison with workflow optimization: Could the authors compare WDA against some existing architecture-search methods, e.g., AFlow?