- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents an empirical study on the GPU energy consumption associated with "latent-space communication" during the inference process of multi-agent large language models (LLMs). Using NVIDIA A100 GPUs and the Qwen3-8B and LLaMA 3.1-8B-Instruct models, the authors compare three approaches: single-agent inference, text-based multi-agent communication (TextMAS), and latent-space communication (LatentMAS).
Critical strengths
- Direct energy consumption measurement provides valuable empirical evidence that goes beyond existing efficiency metrics.
Previous research on "latent multi-agent communication" has primarily focused on reducing latency and the number of tokens. In this study, energy consumption at the GPU board level was measured directly under controlled hardware and inference configurations. The results demonstrate a significant and consistent reduction in energy consumption across two model families. Furthermore, the study incorporates single-agent baselines matched to the specific prompts, accounts for idle power consumption, and provides uncertainty estimates.
- The paper offers a clear analysis of the sources of energy savings while also highlighting significant limitations of the research.
Through a decomposition analysis of individual agents, the study reveals that the primary source of energy savings lies in the reduction of intermediate generation steps, rather than a decrease in the computation time required for a single step. This distinction helps explain the observed results. Additionally, the authors transparently report instances where latent communication underperforms.
Critical weaknesses
- Limited innovation and a lack of necessary control experiments to isolate the actual gains derived from "latent communication."
The paper primarily evaluates the existing LatentMAS framework without introducing any new communication mechanisms or reasoning algorithms. While measuring energy consumption directly is of some value, the observed energy savings are largely attributable to the fact that LatentMAS utilizes only 40 intermediate latent steps, whereas TextMAS generates hundreds of tokens at each intermediate agent stage. It remains unclear whether the efficiency gains stem from the inherent advantages of latent representations or simply from a drastic reduction in the generation budget. The paper fails to provide text-based baselines aligned for equivalent computational budgets, nor does it present "accuracy vs. energy consumption" trade-off curves across varying text-token and latent-step budgets.
- Limited generalization capabilities; the accuracy vs. efficienc trade-off remains unresolved.
The paper’s primary results are based on two 8B-parameter models, a single four-agent sequential topology, and an inference setting with a batch size of 1. The tasks evaluated already exhibit high baseline accuracy, which weakens the study’s arguments regarding more challenging reasoning scenarios.
More importantly, exploratory experiments on the GPQA-Diamond task reveal a significant drop in accuracy for the Qwen3-8B model (52.3% for TextMAS versus only 39.7% for LatentMAS). Although the authors speculate that output truncation may be a contributing factor to this decline, this hypothesis has not been empirically verified. Furthermore, the paper provides no data on energy consumption in scenarios involving batch processing.
Questions for authors
-
How does LatentMAS perform compared to TextMAS when the generation budget is held constant or subjected to systematic variations?
-
In the GPQA-Diamond task, to what extent is the decline in accuracy attributable to output truncation?
-
How sensitive are the energy-saving benefits to factors such as batching and the memory overhead of the KV cache?
Thank you for the detailed reading.
Constant and varied budgets (W1, Q1): global response items 1–3 cover a matched 40-step budget, two further text budgets, and the latent-step sweep m ∈ {0, 10, 20, 40, 80}.
GPQA truncation (Q2): item 8; verified directly in the stored generations, with the conditional accuracies and their selection bias stated.
Batching and KV-cache memory (Q3): the +14% peak-memory overhead is in the paper; batched energy is not measured (item 6), and the scope is now stated as single-stream in the title and abstract.
Novelty: we agree the communication method is prior work. The contribution we now claim is the controlled energy measurement with the budget confound removed, and the finding that the saving is a step-count effect that prompt-only KV reuse (m=0) already captures.