- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
TokenLivelihood simulates a market where LLM agents spend capital on tasks, earn rewards upon success, and use their balances to fund subsequent work. It combines rewards with monopoly, synchronous competition, and asynchronous competition. Using task-execution records, the paper studies how initial capital, competition, and stronger entrants affect task selection and economic outcomes.
Critical strengths
Task-performing agents need to judge whether expected income covers execution costs and preserves resources for future work. Evaluating profitability alongside task success is a useful perspective on deployment.
Critical weaknesses
-
Contribution beyond existing agent economies is unclear. The cited Energy Society and AI Agent Economics already connect resource expenditure, task income, and continued participation. The uncited ClawWork also directly evaluates agents earning task income to cover inference costs. Reference-cost-based rewards and the three task-access regimes provide setting differences, but the paper does not establish what important unresolved question these additions enable it to answer.
-
The results provide limited practical guidance. The main findings concern lower profit with abundant capital, advantages for stronger agents under competition, and wealth gains after stronger agents enter. Some observations are non-obvious, but the paper does not sufficiently distinguish agents' resource-management limitations from effects of the imposed rules. This substantially limits its contribution to understanding and improving economically sustainable agents.
Questions for authors
-
What substantive new insight does TokenLivelihood provide beyond Energy Society, AI Agent Economics, and ClawWork, and why are its pricing and task-access mechanisms necessary to obtain it?
-
To what extent do the reported findings generalize beyond this simulation, and what evidence supports their relevance to practical agent or market design?
Thank you for your review. We hope that the clarifications provided below can dispel your concerns.
Contribution:
TokenLivelihood moves beyond existing environments to answer a fundamental, unaddressed question: how external shifts in economic conditions, specifically capital abundance, cost-based pricing, multi-agent competition, and productivity growth systematically shape agent decision-making and systemic wealth dynamics. Specifically, our work introduces two core extensions that prior frameworks lack:
Bottleneck of Agents:
We further evaluated the agents' ability to accurately assess task solvability and resource requirements across different task categories, finding that current models fail to reliably estimate whether they can complete a task or the token costs required to do so. In particular, on agentic tasks requiring multi-turn iterations, models tend to underestimate their own costs.
We also report the ratio of total wealth achieved under autonomous LLM decision-making to that under complete information (given each model's actual task success/failure outcomes and exact token costs). Overall, access to complete information significantly enhances performance, yielding a notable wealth increase across models. This indicates that improving agents' prediction accuracy regarding task success and token costs can substantially elevate their economic performance.