- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents CoLA, a framework for decentralized multi-robot coordination using frozen Vision-Language-Action (VLA) backbones. The method introduces lightweight learned communication adapters and per-arm diffusion-based action heads, trained jointly through behavior cloning on multi-robot demonstrations. Each robot independently processes its local observations, exchanges learned latent messages with its partners, and generates coordinated actions without a centralized controller. The authors evaluate CoLA on three simulated manipulation tasks under four observation configurations, including an occluded tray handover, two-arm handovers with wrist-only or shared overhead observations, and a three-arm handover chain. The main empirical finding is that learned communication provides substantial benefits when task-relevant information is private to individual agents, while its additional contribution is limited when agents have access to shared overhead observations. The paper also evaluates CoLA with a frozen π0.5 backbone, showing improved conditional target selection over an independently LoRA-fine-tuned baseline, although the overall task success rates are comparable. The work aims to investigate when explicit communication is useful for decentralized coordination while preserving pretrained VLA representations.
Critical strengths
S1. A well-defined and relevant research question. The paper addresses an important practical question in multi-robot learning: when does explicit inter-agent communication improve decentralized coordination over implicit observation alone? Rather than treating communication as universally beneficial, the authors examine its dependence on information availability. This distinction is meaningful for systems built from pretrained VLA models, particularly when modifying backbone parameters is undesirable or computationally expensive.
S2. Useful experimental decomposition and transparent reporting. The paper includes a communication ablation in which messages are zeroed during training and evaluation, allowing the contribution of communication to be examined separately from some of the other architectural components. The per-stage success rates in Table 10 are particularly helpful for distinguishing physical handover failures from target-selection errors. I also appreciate that the authors explicitly acknowledge several limitations of their results, including the unexpected failure of the zero-message model during the tray handover and the lack of a clear overall success advantage in the π0.5 experiment. The additional cross-backbone experiment and conditional success analysis strengthen the empirical presentation.
Critical weaknesses
W1. The main communication ablation does not fully establish the proposed causal explanation. The strongest reported result is on the occluded tray handover, where overall success decreases from 76.0% to 1.3% when comparing the full CoLA model against a separately trained variant with messages zeroed throughout both training and evaluation. However, Table 10 shows that the physical handover completion rate also decreases dramatically, from 92.7% to 8.0%. In comparison, the independent head-only baseline achieves an 88.7% handover rate without communication. This raises an important concern: the large overall performance difference cannot be attributed solely to the inability to transmit the hidden color information. It may also reflect more general coordination information, differences in learned action generation, or training instability in the zero-message model. The authors acknowledge this issue, which is appreciated, but the current evidence does not fully resolve it. A stronger no-message control capable of completing the physical handover, together with more targeted interventions on message content, would substantially improve the causal interpretation. The methodological novelty also needs clearer differentiation from simpler alternatives. In the tray task, the central private variable has only three possible values. An explicit color-label message, a predicted task-state message, or an oracle-information baseline would help determine whether the learned 64-dimensional communication representation provides benefits beyond sharing readily identifiable task information.
W2. Baseline differences and limited robustness evidence weaken the generality of the conclusions. The proposed approach differs from the Octo baselines in several components beyond communication, including the action-generation head, proprioceptive encoding, action horizon, and optimization procedure. In particular, Section 4.2 states that the head-only Octo baselines use a newly initialized proprioceptive tokenizer that remains frozen, whereas CoLA trains its proprioceptive encoder. This difference may disadvantage the head-only baselines. Although the message-zeroed CoLA variant controls for these architectural differences, its severe handover failure on the tray task complicates the interpretation of the largest reported improvement. Further investigation of training stability or a stronger, carefully tuned non-communicating baseline with matched action-generation and proprioceptive components would help clarify the contribution of communication. The experimental evidence for robustness is also limited. The reported results are based on a single trained replicate per method and experimental configuration, without repeated independent training seeds. Furthermore, the three-arm CoLA results are evaluated on only one 200-episode block. Table 11 shows that the 32-dimensional message variant achieves only 42.0% success, compared with 73.3%-76.0% for other tested dimensions. The same table reports substantial degradation under altered lighting conditions. Finally, the claim that communication is unnecessary under shared observations should be interpreted within the tested camera configurations, rather than as a general conclusion about fully or partially observable multi-robot systems. The paper also reports a nominal 5 Hz action-chunk inference schedule without measuring complete online inference latency, which limits the evidence for real-time deployment.
Questions for authors
Q1. What causes the severe physical handover failures in the message-zeroed model? On the occluded tray task, the message-zeroed CoLA model completes the handover in only 8.0% of episodes, compared with 92.7% for full CoLA and 88.7% for the independent head-only baseline. Could the authors clarify whether this behavior arises from missing coordination information, optimization instability, or degradation of the learned action policy? A more targeted experiment separating physical handover performance from hidden-color communication would be particularly informative. Clarification of this issue would substantially affect my assessment of the paper's main claim.
Q2. Does learned latent communication provide advantages over simpler task-state communication? For the occluded tray task, could the authors compare CoLA against a baseline that transmits the marker color directly, or uses a lightweight classifier to predict and transmit the color? Similarly, for the wrist-only handover, how does communicating a predicted object pose compare with the learned message? I would also be interested in whether the authors can provide a matched independent-policy baseline with the same diffusion action head and trainable proprioceptive encoder. This would help separate the benefit of communication from that of the revised action-generation pipeline.
Q3. How stable are the findings across training runs and observation conditions? Could the authors clarify the large performance drop for the 32-dimensional message ablation and, if available, provide results from independent training seeds? Additional clarification of the three-arm evaluation variability and the substantial performance degradation under altered lighting would help establish the robustness of the conclusions. For the π0.5 experiment, a no-message CoLA ablation would also help isolate the communication contribution from differences in manipulation reliability. Finally, reporting measured end-to-end online inference latency would help substantiate the deployment-related claims.
2 comments
Response to Reviewer 4nC2 (2/2)
Q2 / W2: Matched independent-policy baseline.
This is CoLA (message zeroed) in the paper. CoLA (message zeroed) uses the same diffusion head, trainable proprioception encoder and training recipe and hyperparameters. With 5 training seeds: CoLA outperforms the independent policy baseline, CoLA (message zeroed), across all 5 tasks.
W2: Frozen proprioceptive tokenizer in head-only baselines.
This is a fair point. Our claims, however, rest on CoLA vs. CoLA (message zeroed). The full fine-tuning baselines train all parameters in Octo and is a stronger comparison to CoLA. For example, the decentralised full finetuning baseline matches CoLA on two arm handover, overhead camera (% vs. %), while CoLA is more efficient to train.
Q3: Stability across runs and conditions.
Seeds. All methods now use 5 training seeds (0, 1000, 2000, 3000, 4000).
32d message. The 42.0% was single-run noise on the original task. On the randomised start variant of the tray task: , , and % for 16d, 32d, 64d and 128d.
Three-arm. Each seed is now evaluated on 1,000 episodes. Seed variance is large on the overhead variant with CoLA ahcieving % success rate and no message model reaching %.
Lighting. Performance of CoLA in the hidden tray task still degrades under unseen lighting: % (bright), % (dim), % (dark), vs. 89.3%. Most of the loss is in the handover (70.5% completion in the dark condition), while if the box reaches a tray, arm B chooses the correct tray 78-87% of the time, against 33.3% by chance. We attribute this mainly to the frozen backbone's visual features and we will report it as a limitation in the paper.
without messages. % vs. % for CoLA on the same frozen backbone ( points).
Q3: Inference latency.
300 calls per arm at batch size 1, after 30 warm-up calls. Each call covers the backbone on the camera frame, state embedding, message encoding/decoding, and 10-step diffusion sampling of a 10-action chunk.
Table 8: Inference Latency of CoLA
| Backbone | GPU | One arm | Both arms |
|---|---|---|---|
| Octo | RTX A6000 | 79–80 ms | 158 ms |
| Octo | A100 40GB | 89–92 ms | 183 ms |
| RTX A6000 | 189–193 ms | 377 ms | |
| A100 40GB | 223–231 ms | 456 ms |
With Octo, one arm's call (~80 ms) is under the 200 ms query period, leaving ~120 ms for message exchange, and both arms fit on one A6000. fits only with one A6000 per arm, where CoLA head ran on CPU, contributing 60-90 ms latency. We have not measured a real network link, however, robustness to simulated message delay and dropout (including CoLA trained with random delay and loss) is in our response to Reviewer qkUS.
W2: Communication is unnecessary under shared observations should be interpreted within the tested camera configurations
We agree. With 5 seeds, the no message CoLA variant underperforms in a shared overhead camera from % to % (two arms) and from % to % (three arms). CoLA outperforms its matched no message variant in every setting tested in the paper, with the largest performance gained when the task-relevant variable is private to one agent (tray: points). We will revise the paper's claims accordingly and scope them to the tested camera configurations.
Response to Reviewer 4nC2 (1/2)
We thank the reviewer for the detailed and fair review. All new results use 5 independent training seeds (mean ± SD). We also designed a new variant of the occluded tray task with a randomised starting position. All tray results below are on the randomised variant of the task, where CoLA reaches 89.3±3.7% vs. 19.9±3.2% without messages.
Why the handover failed for message-zeroed. First, the submitted result came from the original fixed start task. After running the original task with 5 seeds, handover completion ranges from 47.3% to 98.0% with messages and from 1.3% to 38.0% without, so the submitted 8.0% came from a fragile, high-variance setting. However, the model without messages still completes fewer handovers in every seed. Second, a consistent gap still remains on the randomised start variant of the tray task (97.1±2.9% vs. 66.7±6.9%), and our experiments point to missing information about the partner's state. On two arms handover task with overhead, replacing each arm's learned message with its partner's joint angles and gripper opening is comparable to CoLA (83.9±4.2% vs. 80.0±5.6%, 95% CI [−6.9,+14.8]), against 55.8±3.3% without messages. Moreover, delaying CoLA's messages by one policy query lowers tray handover completion from 96.7% to 82.1%, so arm B relies on up to date message content to complete the handover.
Targeted intervention on message content. From the moment arm B first touches the box, we replace A's message with a recorded message from a demonstration of a different colour. Handovers still complete 96.4±3.3% of the episodes, and B places the box in the new colour's tray (demonstration colour) in 94.7±1.4% of them, and in the original tray in only 3.2±1.2%. Arm B received the correct colour for roughly the first half of the episode, yet the later message still determines which tray arm B chooses.
We replace A's learned message to B with a hand-built vector, a one-hot colour, and optionally together with Arm A's normalised joint angles and gripper opening, zero-padded to 64d. Arm B's message to A, the action head, and all other modules are the same as CoLA. True colour rows are trained from scratch with the colour read directly from the simulator. The classifier is a small MLP on A's wrist features (rollout accuracy 82.6% for colour only, 97.5% for colour + state). The classifier experiments reuse the true colour checkpoints, so the gap from the true colour rows is caused by purely misclassification.
Table 6: CoLA vs. explicit colour messages (tray task)
Colour alone underperforms CoLA because due to lower handover rates. Adding A's state fixes this problems and exceeds CoLA by 6-9 percentage points. A hand designed message can therefore outperform CoLA if it is crafted to tailor to the task specific hidden information. CoLA's advantage is that the same module is used unchanged across tasks and backbones (Octo and π0.5), without the colour labels or specifying what to send.
Table 7: Box-position messages on the two arm handover, wrist camera (task success %, 5 seeds)
For the wrist only handover, we replaced each arm's learned message with the box's position (x, y, z), either the true position from the simulator, or position predicted by a small regressor on the sender's own wrist-camera features and joint state. Everything else matches CoLA's architecture. Both variants reach about 81% success, 4 points below CoLA, a difference that is not significant, and both clearly outperform the model without messages (68.6±6.1%). The predicted position performs as well as the true one (−0.3 points, [−5.9,+5.4]). Thus, handcrafted, task specific messages are able to achieve similar performances to CoLA. However, CoLA is task agnostic, and able to enable coordination across diverse tasks. CoLA is re-evaluated here through the same evaluator as the new variants (85.4±6.2% reported).