- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes OneRoll, a unified physical latent flow model for robotic manipulation. The method maps actions, proprioceptive states, and visual observations into a shared latent space and combines them through linear addition. A shared vector field and flow matching are then used to predict future latent states, enabling unified modeling of multimodal physical dynamics. The authors further introduce training objectives for velocity supervision, future-modality reconstruction, latent consistency, and cycle reconstruction. Experiments are conducted on LIBERO-X, EBench, RoboLab-120, and real-robot manipulation tasks. The reported results demonstrate competitive task success rates, and comparisons with methods such as A2A and modality ablations provide evidence of the method's potential. However, the independent contribution of the unified latent evolution mechanism and the verifiability of some experimental results remain unclear.
Critical strengths
The paper explores the idea of unifying actions, proprioceptive states, and visual observations into a single evolving latent representation, using a shared dynamics model to predict future states. This provides a potentially interesting modeling direction for robotic world models. The experiments cover multiple simulation benchmarks, transfer from real-world data, and real-robot manipulation. In particular, comparisons with A2A provide some evidence supporting the potential of the proposed approach. These results demonstrate that the paper goes beyond a conceptual proposal and includes substantial experimental investigation.
Critical weaknesses
- Limited methodological novelty. The paper aims to fuse actions, proprioceptive states, and visual observations, which is a reasonable direction. However, the fusion operation in Eq. (4) simply adds the features of the three modalities, which offers little novelty at the level of multimodal fusion methods.
- Limited mathematical novelty and potentially redundant objectives. Equation (7) is essentially the derivative of Eq. (4), which appears to be a mathematically correct but straightforward derivation with limited necessity. Equations (9) and (11) also have considerable overlap: the former reconstructs future data from the integrated representation, while the latter reconstructs data from the encoded future representation. More importantly, given that Eq. (9) requires the predictions to reconstruct future data and Eq. (10) requires the predicted representation to approach the encoded future representation, it remains unclear whether the cycle reconstruction loss in Eq. (11) provides indispensable supervision.
- Significant concerns regarding the experiments. Around line 352, the paper states that the exact task and trial counts for each LIBERO-X level will be added once the evaluation protocol is finalized. Appendix A.3 similarly uses future tense to indicate that task lists, trial counts, post-training settings, and success criteria will be provided later. Does this mean that the experiments have not yet been completed? Moreover, Table 2 reports success rates of 0% for some tasks and 99% or 100% for others. How do the authors explain these results? In particular, line 374 states that the baseline methods and the latest OneRoll run use 20 trials per task. If so, success rates should change in increments of five percentage points (e.g., 90%, 95%, or 100%), making a reported rate of 99% impossible. This raises concerns about the reliability of the reported results.
- Insufficient visual evidence for the real-robot cooking experiments. The real-robot potato-preparation and cooking experiments are interesting and offer evidence beyond simulation, provided that they were conducted as reported. However, the robot images in the appendix appear to lack the relevant objects. For example, the first row depicts pouring oil, and the second depicts adding potato shreds, yet neither the oil bottle nor the potato shreds are visible. These images do not clearly substantiate the claimed manipulation steps. In contrast, Figure 3 at least shows potatoes in a container.
- Insufficient isolation of the core contribution. The ablation studies do not establish how much of OneRoll's performance improvement can be attributed specifically to the unified latent evolution mechanism introduced in Eq. (4).
Questions for authors
- Limited methodological novelty and insufficient validation of the core contribution. Equation (4) primarily performs multimodal fusion by summing linearly projected features, which is a standard operation. Equation (7) follows directly from this linear fusion definition and offers limited theoretical novelty. In addition, the supervision objectives in Eqs. (9)–(11) exhibit some overlap, and their necessity is not sufficiently justified. The existing ablations do not adequately demonstrate that unified latent evolution itself is superior to conventional multimodal fusion followed by separate prediction heads.
- Important inconsistencies in experimental reporting affect verifiability. Table 2 reports success rates of 0% for some tasks and 99% or 100% for others. How do the authors explain these results? Moreover, line 374 states that the baseline methods and the latest OneRoll run use 20 trials per task. If so, success rates should change in increments of five percentage points (e.g., 90%, 95%, or 100%), making a reported rate of 99% impossible. This raises concerns about the reliability of the reported results. More concerningly, the paper states that each task is evaluated over 20 trials, yet EBench Table 2 reports a success rate of 99.0%. If this metric is calculated directly from 20 binary trial outcomes, such a value is impossible. Around line 352, the paper states that the exact task and trial counts for each LIBERO-X level will be added once the evaluation protocol is finalized. Appendix A.3 similarly uses future tense to indicate that task lists, trial counts, post-training settings, and success criteria will be provided later. Does this mean that the experiments have not yet been completed? The authors need to clarify the actual evaluation protocol and success-rate calculation; otherwise, the reliability of the reported results cannot be adequately assessed.
- Insufficient isolation of the architectural contribution and limited visual evidence for real-robot results. The paper reports extensive pretraining, but the current experiments do not adequately distinguish the contribution of unified latent evolution from that of the pretraining data and computational scale. Furthermore, although the real-robot cooking experiments are valuable, the appendix images do not clearly show some of the key objects and interactions involved in the claimed manipulation steps. Each subtask is evaluated over only 10 trials, and the overall success rate for completing the entire nine-stage task is not reported. Consequently, the current evidence is insufficient to fully support stronger claims about reliable long-horizon real-world manipulation.