- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes thought blocks, a mechanism for multi-agent LLM to reduce latency. Instead of generating sequential intermediate latent states, this paper proposes to build fixed-size KVC continuation states. This is done by distilling continuation states from a teacher's sequential rollout. Across experiments, the methods reports 2.5x latecy improvement over sequential latent communication.
Critical strengths
- The method seems practically implementable.
- Experiments show substantial improvements over baseline.
Critical weaknesses
-
insufficient comparisons against closely related SOTA. For example, "Cache-to-Cache: Direct Semantic Communication Between Large Language Models" and "Parallel Continuous Chain-of-Thought with Jacobi Iteration".
-
all experiments are done in one fixed controlled setting, so wider applicability is still in question. For example, iterative collaboration (may benchmark with "Sanzaru: Benchmarking Protocol Formation under Epistemic & Communication Asymmetry"), different communication graphs, or even heterogeneous agents will be very informative on wider applicability.
Questions for authors
See weaknesses
Dear Authors,
Thank you for you efforts! Your response has fully addressed my concerns and questions. I will update my score to 3: Weak Acceptance.