- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a Koopman-inspired transition module for WAMs. It jointly learns control coefficients and a shared operator family, combining operator-based evolution with a nonlinear additive correction. It replaces the classic Transformer transitions in VLA-JEPA and LaWAM while retaining their prediction targets and policy interfaces. Evaluation includes manipulation benchmarks, ablations, and controlled physical systems, reported in policy success and state-range extrapolation.
Critical strengths
-
I find the joint learning of observables and structured transitions well motivated. Demonstrating the same formulation in both prediction-supervised policy learning and future-conditioned action generation makes its applicability more convincing than that within a single WAM architecture.
-
LEON outperforms matched Transformer and residual MLP baselines by 5.1 and 5.4 on LIBERO-Plus, supporting the value of its structured transition beyond predictor reinitialization or generic nonlinear capacity.
Critical weaknesses
-
Learned observables and Koopman-based state prediction already appear in Efficient Dynamics Modeling in Interactive Environments with Koopman Theory (2024) and Learning Bilinear Models of Actuated Koopman Generators from Partially Observed Trajectories (2024). In LEON, the matched WAM comparisons establish an advantage over generic predictors and internal variants, rather than over an existing learned Koopman transition adapted to the same interface. This leaves unclear how much additional methodological value LEON provides beyond incorporating established operator-learning ideas into modern WAMs.
-
Parameter sharing is explicit in the architecture; its existence is not in question. What remains less clear is what consistent dynamical behavior the shared operators capture when their coefficients depend nonlinearly on the current representation and the correction is itself an MLP. The component ablations and controlled-system diagnostics provide only indirect evidence about the learned decomposition. I do not require recovery of true physical laws; an operator-level analysis would help explain what the physics-motivated structure contributes beyond an effective conditional predictor.
-
Separately, the policy results use one training run per variant. Repeated rollout evaluations do not measure training variability, which limits confidence in the smaller gains, particularly the 0.53-percentage-point average improvement on RoboTwin 2.0.
Questions for authors
- Which specific aspect of LEON constitutes the main advance over earlier learned Koopman or bilinear transition models? I appreciate a comparison with one such model under the same WAM interface and comparable training budget, with training-run variability reported.