- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper tudies resource amplification through third-party skills that preserve the host agent’s ability to skip work or finalize. Across three benchmarks and two models, reported completion-token amplification ranges from 3.34× to 94.50×. Additional analyses examine per-instance increases, reasoning-token attribution, defense overhead, and native OpenClaw deployment. A statistical argument bounds false median-amplification qualification for frozen finalists under conditional i.i.d. assumptions.
Critical strengths
The paper demonstrates a practically relevant failure mode. Final-answer accuracy can conceal substantial resource abuse.
The instance-level analysis strengthens the aggregate result. Positive completion-token increments occur on 91.7–100% of evaluated instances, with all interquartile ranges above zero and median increments around 6.2k–23.7k tokens.
The protocol preserves an explicit finalization option. Work is optional, repeated work-unit identifiers are disallowed, and the controller can finalize immediately.
Critical weaknesses
The empirical qualification status is not sufficiently connected to the headline results. The algorithm always returning a skill does not mean it found a skill satisfying the stated constraints.
The median-amplification guarantee is much weaker than the headline ratios suggest.
The closest baseline comparisons are limited and not demonstrably budget-matched. Those adaptations make consequential choices about workflow structure, finite retries, and metadata selection. Meanwhile, CUCKOO SKILLS receives a multi-generation feedback-guided search. The manuscript does not provide a complete matched search-budget comparison. The shared-catalogue controls are useful evidence for the search design, but do not establish superiority over faithfully tuned versions of the closest prior systems across all domains. The claims should distinguish broad empirical comparisons from tightly controlled mechanism comparisons.
Questions for authors
Can intermediate artifacts be independently verified and shown to contribute useful information? Do the gains persist against matched benign workflows and closely related attacks under equal search budgets?
Response to Reviewer Kt2n: Discussion of the Novelty of CUCKOO SKILLS
Dear Reviewer Kt2n,
Thank you for encouraging us to articulate our contribution more sharply.
Our technical novelty lies in jointly designing the attack search space and the qualification rule. APSC makes optional task-directed work and its handoff requirements searchable, while BERS makes cross-instance amplification an eligibility condition before aggregate-cost maximization.
1.
Motivation: Framing task-compatible resource abuse as a constrained construction problem.Our motivating insight is that task-relevant intermediate work can itself become a vehicle for resource abuse, even when the host remains free to skip that work or finalize immediately. We formulate this as a constrained construction problem: optimize a reusable skill's proposed work and deliverables while measuring adoption, verified work, and task utility. This connects resource amplification to the design of useful workflows and to measurable conditions for their execution.
2.
Challenges: A coupled feasibility problem under host autonomy.The distinctive challenge lies in the interaction among workload size, host choice, artifact usability, and amplification coverage. Increasing the workload may encourage the host to skip optional work, reducing realized cost. Executed work may fail to yield a usable handoff, while a high aggregate CAR can arise from only a few costly tasks. Construction must therefore coordinate execution triggers, computation, and deliverables, while selection separately assesses cross-instance amplification. APSC and BERS address these dependencies through the joint design of the admissible candidate space and the acceptance rule.
3.
Solution: A distinct search space paired with a cross-instance qualification gate.APSC optimizes the coupled trigger, computation, and handoff contract under a finalization-preserving constraint. CDH uses feedback to refine routing and activation descriptions around a predefined body-construction protocol. APSC applies typed catalogue edits to iteratively revise optional work and its task-artifact requirements. Clawdrain and Beyond Max Tokens organize amplification around verification protocols and protocol-gated payload release. APSC searches for costly work within a space that preserves immediate finalization and excludes mandatory work sequences or minimum call counts. These differences change both the optimization variables and the admissible candidate space.
BERS separates paired cross-instance cost-ratio qualification from aggregate-cost ranking. OTora incorporates a stability penalty into its optimization score. BERS uses a calibrated lower-order statistic of paired, smoothed log-cost ratios as a separate qualification gate, alongside utility, skill-entry, and verified-work thresholds. Higher CAR cannot make a candidate that fails this gate qualified. Among qualified candidates, CAR determines the ranking, and frozen finalists undergo final evaluation on a fresh common bank. This separates evidence of cross-instance amplification from the objective of maximizing aggregate cost.
The coupling is operational: gate outcomes guide parent retention and inform subsequent work edits. Qualification shapes the skills produced during search.
The table compares capabilities explicitly specified in each work. Agent-level attack targets multi-step agent execution involving tools or environmental interaction. Utility-aware optimization incorporates task performance or answer fidelity into automated scoring or admission. Statistical guarantees concern selection-error control under stated assumptions.
Together, these advances establish a concrete optimization framework: search task-directed work and its deliverables under autonomy constraints, qualify amplification across tasks, and maximize cost among qualified candidates.
We would appreciate your reconsideration of our work's novelty in light of these methodological distinctions.