- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This manuscript proposes Expert-Inversion Prior (EIP) to improve generative policy by learning a conditioned noise prior. The authors invert expert actions into the initial noise space and train either a conditional Gaussian or Flow prior. The paper further provides theoretical analysis based on KL-divergence preservation and evaluates the proposed approach across simulation and real-world tasks, demonstrating substantial improvements in task success rates.
Critical strengths
-
The manuscript investigates an interesting and practically relevant problem: improving pretrained flow-based policy without modifying the original action generator or requiring additional demonstrations.
-
The empirical results are encouraging, showing substantial improvements across multiple benchmarks, architectures, and real-world tasks.
Critical weaknesses
-
Limited novelty and incomplete related work. The central idea of learning a conditional initial noise prior for a frozen generative model has been explored in previous works, such as NoiseAR[1] and Golden Noise[2]. Moreover, FRS/DSBC[3] has already investigated learning noise-space policies from inverted expert demonstrations, while BridgePolicy[4] explores observation-informed initialization for robotic policies. Although some related robotic approaches are cited, this work does not sufficiently distinguish its methodological contributions from these prior studies, and several closely related works are missing.
-
The necessity of prior learning is not convincingly demonstrated. The deterministic MLP baseline already achieves most of the performance improvements, while EIP-Flow provides only modest additional gains over EIP-Gaussian. Furthermore, the retrieval experiments show that directly selecting expert-inverted starting points can substantially improve success rates without training an additional generative prior. These results raise questions about whether learning a complex conditional noise distribution is necessary.
-
Limited evaluation of generalization and robustness. Optimizing an distributional prior may improves the perfomance on some specific tasks, however, it can also harms the generalization and robustness. The authors may conduct some addition experiments on generalization and robustness.
[1] Li Z, Liu X, Zhang X, et al. Noisear: Autoregressing initial noise prior for diffusion models[J]. arXiv preprint arXiv:2506.01337, 2025.
[2] Zhou Z, Shao S, Bai L, et al. Golden noise for diffusion models: A learning framework[C]//2025 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2025: 17688-17697.
[3] Tang A, Chen W, Wagenmaker A, et al. Improving Robotic Generalist Policies via Flow Reversal Steering[J]. arXiv preprint arXiv:2606.13675, 2026.
[4] Liu Z, Pan M, Wang Z, et al. Sample from What You See: Visuomotor Policy Learning via Diffusion Bridge with Observation-Embedded Stochastic Differential Equation[J]. arXiv preprint arXiv:2512.07212, 2025.
Questions for authors
See Critical Weaknesses