From Multi-Agent to Single-Agent: When Is Skill Distillation Beneficial?
Abstract
Multi-agent systems (MAS) for structured data-science tasks externalize analytical control through workflows, but repeatedly executing orchestration incurs deployment overhead. Distilling workflows into single-agent skills raises a selective-transfer question: which components should survive? We distinguish capability resources, which expand available actions and knowledge, from pipeline guidance, which constrains explored solutions. On the same causal-estimation instances, capability-matched pipeline retention changes normalized utility by points under method-selection accuracy but under numerical error. We introduce Behavior-Outcome Freedom (), a pre-synthesis diagnostic of signed behavior–outcome rank mismatch, and give a candidate-conditional account through Signed Anchor-Rank Transfer with an explicit remainder for coarse representations. AdaSkill preserves validated capabilities, removes runtime orchestration, and calibrates an -threshold on module-level development interventions, freezing it before target construction. Across 16 matched interventions, structural effect decreases with (, ); 15 atomic treatments localize the reversal to pipeline guidance. Across 11 datasets and four task families, directly executed skills combine strong performance with lower latency than source workflows. Workflow-excluded construction tests the calibrated policy separately from the mechanism analysis.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.