- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes Hive, an inference infrastructure for multi-agent workloads. It introduces Logits Cache to reuse decoding results across repeated reasoning branches, and Agent-Aware Resource Allocation to improve KV-cache management based on agent runtime characteristics. Experiments report improvements in resampling throughput and cache hit rates.
Critical strengths
The paper studies inference-efficiency problems in branching reasoning and multi-agent systems. Logits reuse is an interesting direction for reducing redundant computation.
Critical weaknesses
- Unclear problem formulation. The proposed distinction between algorithm-level and task-level scaling is not well justified. The paper essentially studies redundant decoding and KV-cache eviction, rather than demonstrating new scaling capabilities at either level.
- Limited methodological innovation. Step-wise Logits Cache mainly reuses previously computed logits, while Hotspot Sampling relies on a heuristic uncertainty score. Agent-Aware Resource Allocation uses a heuristic priority function based on runtime statistics. The technical novelty over existing caching, resampling, and resource allocation methods is unclear.
- Insufficient experimental validation. The scale of experiments is very small, and the justification for the tradeoff between search quality and diversity is not sufficiently discussed for Hotspot Sampling.
Questions for authors
Please refer to the weakness part. My main concern is the methodology design part. The technical novelty over existing caching, resampling, and resource allocation methods is unclear.