- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper finds that entropy, maximum probability, and hidden-state norm carry predictive information about downstream correctness, suggesting their utility for adaptive routing among TEXT, LATENT, and SKIP. Therefore, this paper proposes ReLay, a two-level routing framework for effective multi-agent collaboration. Experiments on reasoning and long-horizon decision-making tasks show that ReLay achieves an optimal balance between overall performance and efficiency, outperforming various baselines while significantly reducing communication costs.
Critical strengths
- Segment-level representation selection addresses a meaningful communication problem.
- Experiments cover multiple tasks, backbones, and coordination structures, with useful component ablations.
- The paper examines latent information transfer and acknowledges its bandwidth and fidelity limitations.
Critical weaknesses
- The paper states that the results are derived from the average of three complete evaluation runs; this is highly unrigorous. For a dataset like AIME2026, the variance is significant, and it is standard practice within the community to use or for evaluation.
- The main novelty appears to lie in receiver-utility-based segment selection among TEXT, LATENT, and SKIP. Please clarify the advances over existing hybrid communication and confidence-based switching, like HyLaT and ThinkRouter.
- SCUR’s supervision depends on a background mask, but this mask is absent from its inputs. How reliable are these utilities when multiple segments are jointly routed?
Questions for authors
None
5 comments
Dear Reviewer,
I hope this message finds you well. As the discussion period is nearing its end, with less than 4 days remaining, we wanted to ensure that we have addressed all your concerns satisfactorily.
If there are any additional points or feedback you would like us to consider, please let us know. Your insights are invaluable to us, and we are eager to address any remaining issues to improve our work.
Thank you for your time and effort in reviewing our paper.
Dear Reviewer U5so, Thank you once again for your valuable comments on our submission. As the discussion phase is approaching its end, we would like to kindly confirm whether we have sufficiently addressed all of your concerns. Should there be any remaining questions requiring further clarification, please do not hesitate to let us know. If you are satisfied with our responses, we would greatly appreciate your consideration in adjusting the evaluation scores accordingly.
We sincerely look forward to your feedback.
We sincerely thank Reviewer for the constructive feedback. We address comments below
W1: Evaluation Reliability Our initial evaluation was 3 seeds due to computational constraints. We conducted additional 5-seed evaluations of competitive baselines on both benchmarks
AIME26 — Qwen3.5-9B
HMMT Feb — Qwen3.5-9B
The results show consistent performance across seeds. ReLay outperforming the strongest baseline on AIME26 and remaining competitive on HMMT, provide further evidence of evaluation reliability.
W2: Advances over Prior Work We appreciate these insightful works. Unlike prior hybrid communication protocols and token-level reasoning switches, ReLay learns to selectively transmit reasoning segments based on their predicted downstream utility to the receiver. We will add comparisons in Appendix F. The key distinctions are summarized below.
W3: SCUR under Joint Routing For efficiency, we adopt streaming processing, routing each segment upon generation and retaining only its selected transmission form. Since future routing decisions are unavailable, SCUR estimates each segment's weighted-average downstream utility across sampled contexts (Eq. 7). Finer-grained joint-context modeling remains a promising direction.
Experiment. We evaluate joint routing on 298 MATH/GPQA problems. SCUR jointly transmits the top-k segments ranked by Eq. 4, while the baseline randomly selects k segments (averaged over two draws). Both use matched token budgets and either TEXT or LATENT transmission. We use 5-fold problem-level cross-fitting to obtain out-of-fold scores.
SCUR outperforms random selection by 9–19 pp for k≤3, with all improvements statistically significant (95% bootstrap CIs). The advantage persists at k=5, beyond the training context sizes. Moreover, average segment utility predicts joint-message success (within-problem AUC 0.723 ± 0.009 for TEXT and 0.697 ± 0.002 for all-LATENT, mean ± std over 3 seeds). We will add these results to the Appendix.