-
I believe the NeRF-like per game fitting paradigm of this proposed method is the biggest limitation. Mainly because the model is only learning the world state, rendering system, and rudimentary physics of the underlying game, and is not at all learning the game-mechanics, level-design, and other sophisticated game-systems that are a part of typical AAA video games, RPG or otherwise. A singular video-game styled world modeling doesn't offer specific advantage over just being able to walk around and jump across 3D worlds for hours. The paper does a good job explaining well what they have actually done, but I believe it fails to motivate the actual scenario/use-case that they are after.
-
This point then trickles down into a major scientific issue, which is comparing to the 4 true World-Model baselines is not fair on various axes. a. First, all other comparisons are to true-world models, for instance Yume1.5 [1] allows for both text-and-first frame generalizable control. So do the rest of the baselines [2, 3, 4] either through text or image. While StreamingAAA is only trained on Genshin Impact, and evaluated on Genshin Impact, as opposed to others which are trained on much more diverse settings and scenarios. b. Second, all others are Transformer based backbones (DiTs) which StreamingAAA is UNet based, so the latency being better is not really surprising. The ideal comparison should be: at-least on one of the baselines to match the backbone UNet, and trained equally on you Genshin Impact dataset. c. Whereas some of the baselines do provide options of world interactivity, StreamingAAA is limited to subject movement, and world look-and-feel controllability via weather and time-of-the-day conditioning.
-
More on the demonstrated results, there are still several shortcomings: a. In spite of being such a specialized training setup, as a single video game, there are significant visual artifacts that renders deployment for a real-world use-case impractical. Not to mention the requirement of A100 gpus, which are far far far away from consumer grade hardware. b. The authors evaluate their results with VBench, which should be done probably, but because you do have a deterministic game setup here, you could actually evaluate true signal processing first-class metrics like PSNR/SSIM in this case. I believe these would still be much lower like in the range of 15-20, and that will clearly demonstrate how far this model is from actual interactive use-cases. Also, I feel like the chosen dimensions from VBench are also a bit mis-representative. For instance subject consistency will be high by design, because all frames will always have the video-game character subject. The background consistency for instance is the more telling axis in this case. But nevertheless, neither of the results shine light on anything new.
-
Finally, the proposed method has no new ideas and/or insights. a. The highly compressive VAE is not new. Many papers [5, 6, 7, 8, 9, 10] have at this point proposed ways of using high spatial compression, but neither of them have been able to temporally compress the latents significantly. This could have been a good opportunity for StreamingAAA to make actual impact here (something similar to Nvidia's FrameGen), but they miss out on it, by sticking to simple 4x temporal compression. b. The Diffusion Forcing based pretraining and DMD post-training is an interesting design choice, but I believe has been wasted on UNet. Except for highly specialized and commoditized use-cases, there is no demand for UNets in the industry at the moment. More and more OEMs, as well as deployment settings are asking for efficient DiTs over UNets. Again, the long-horizon training is actually possible, because of the tiny <2B UNet that the authors are training, and not because of any special cool-new tricks from authors that enables this.
References:
[1] Mao, X., Li, Z., Li, C., Xu, X., Ying, K., & Zhang, K. (2026). Yume1. 5: A text-controlled interactive world generation model. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 7752-7761).
[2] Sun, W., Zhang, H., Wang, H., Wu, J., Wang, Z., Wang, Z., ... & Guo, C. (2025). Worldplay: Towards long-term geometric consistency for real-time interactive world modeling. arXiv preprint arXiv:2512.14614.
[3] Wang, Z., Liu, Z., Li, J., Huang, K., Xu, B., Kang, F., ... & Zhou, Y. (2026). Matrix-game 3.0: Real-time and streaming interactive world model with long-horizon memory. arXiv preprint arXiv:2604.08995.
[4] Team, R., Gao, Z., Wang, Q., Zeng, Y., Zhu, J., Cheng, K. L., ... & Ouyang, H. (2026). Advancing open-source world models. arXiv preprint arXiv:2601.20540.
[5] Wu, Y., Zhang, Z., Li, Y., Xu, Y., Kag, A., Sui, Y., ... & Ren, J. (2025, June). Snapgen-v: Generating a five-second video within five seconds on a mobile device. In 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 2479-2490). IEEE.
[6] Wu, Y., Li, Y., Skorokhodov, I., Kag, A., Menapace, W., Girish, S., ... & Tulyakov, S. (2025). H3ae: High compression, high speed, and high quality autoencoder for video diffusion models. arXiv preprint arXiv:2504.10567.
[7] Wu, Y., Li, Y., Kag, A., Skorokhodov, I., Menapace, W., Ma, K., ... & Tulyakov, S. (2025). Taming diffusion transformer for efficient mobile video generation in seconds. arXiv preprint arXiv:2507.13343.
[8] Karnewar, A., Korzhenkov, D., Lelekas, I., Fathima, N., Karjauv, A., Ghafoorian, M., & Habibian, A. (2026, April). Neodragon: Mobile video generation using diffusion transformer. In International Conference on Learning Representations (Vol. 2026, pp. 39506-39537).
[9] Zhao, L., Wu, Y., Lebedev, A., Lahiri, D., Dong, M., Sahni, A., ... & Li, Y. (2026). S2dit: Sandwich diffusion transformer for mobile streaming video generation. arXiv preprint arXiv:2601.12719.
[10] Ghafoorian, M., Korzhenkov, D., Karjauv, A., Lelekas, I., Fathima, N., Stasis, S., ... & Habibian, A. (2026). MobileWan: Closing the Quality Gap for Mobile Video Diffusion. arXiv preprint arXiv:2607.06173.
Justification: This paper contributes nothing except for providing a singular datapoint of somewhat working empirical evidence for the hypothesis that "A specialized UNet with specialized training for a singular specialized task (Genshin impact game frame generation) could be better than the Transformer". Due to its limited impact, I therefore propose a weak rejection.