- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes MOSAIC, which is a test-time adaptation framework for pretrained VLA policies. The paper introduces two mechnisms for the purpose. The first is Cross-Policy Action Distillation (CAD), which leverages successful trajectories to update a policy that failed on the same initial sate. The second is Within-Policy Trajectory Consolidation (WTC), which trains a policy on its own trajectories using re-noised action samples. Adaptation and evaluation use held-out initial states. Across four simulation benchmarks, CAD reports an average success-rate improvement of 3.03 percentage points, while WTC reports an average improvement of 2.91 percentage points across 22 policy–benchmark combinations.
Critical strengths
-
CAD reports gains in 103 of 104 directions across 52 policy pairs and four simulation benchmarks. Although uncertainty estimates are missing, the breadth of these results suggests that fine-tuning on successful trajectories is useful across different VLA architectures.
-
The adapted policies are frozen and evaluated on initial states not used for adaptation. This strengthens the evidence that the gains carry over to new initial conditions rather than just improving repeated attempts on the same instances.
Critical weaknesses
-
The paper does not show that peer data adds anything over self-generated data. The main comparisons are against frozen policies, so they do not separate the benefit of peer data from that of collecting successful trajectories and fine-tuning on them. A comparison of peer-generated and self-generated successful trajectories under the same optimization budgets is necessary. Collaboration is the paper’s central contribution, but its advantage over self-training is currently unsupported.
-
WTC’s claimed effect is not in the method, and the method is undefined for several evaluated models. Equation (8) averages the native loss over K noise samples. Its expectation is unchanged, and there is no cross-sample consistency term. Whether it improves repeatability is an empirical question, but Table 8 only reports average success rates, so the claim is untested. I think it's necessary to compare with ordinary fine-tuning at the same compute, measuring repeated success on fixed initial states. Separately, the diffusion formulation and re-noising procedure do not apply to standard OpenVLA-OFT’s L1 regression head or G0.5’s autoregressive action tokens, yet both appear in the results. Until the losses actually used are specified, the paper does not describe the method that produced its tables.
Questions for authors
- Does CAD outperform fine-tuning on the receiving policy’s own successful trajectories under matched rollout and optimization budgets?
- On fixed initial states with repeated seeds, does WTC improve repeated success over ordinary fine-tuning at equal compute?
- Did WTC use only successful trajectories or all rollouts? How were its loss and re-noising implemented for OpenVLA-OFT and G0.5?