- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
DiscreteWorld is to quantize both camera actions and visual observations into a unified discrete token space for joint reasoning and generation, yielding two essential advantages. First, unified action-vision modeling in the same token space enables precise semantic alignment between the two modalities, leading to accurate and reliable action following. Second, viewing discretization as a form of refinement and compression, the authors conduct the entire world modeling—including semantic understanding and video generation—in a discrete token space to facilitate the learning of higher‑quality latent compressed representations, which is crucial for world models. Additionally, the authors build our DiscreteWorld upon GRNs—a text‑to‑video discrete generative model—and thereby naturally inherit its iterative visual refinement capability for high‑quality video synthesis. Extensive experiments on real-world and game scenarios show that DiscreteWorld achieves more accurate action following and more stable long-horizon generation than prior diffusion-based world models.
Critical strengths
The paper addresses action controllability and long-horizon consistency, two important challenges in world exploration. The motivation for exploring discrete generative modeling beyond conventional diffusion-based approaches is clear and relevant. And the overall framework is well organized, the main components are relatively easy to follow.
Critical weaknesses
-
The proposed method largely inherits HBQ, iterative discrete refinement, and visual token generation from GRNs. Its main contributions appear to be discretizing camera actions and introducing an anchor-history-prediction structure. Therefore, the proposed unified action-vision modeling resembles an action-conditioned extension of GRNs rather than a fundamentally new world-modeling mechanism. The authors should better clarify the methodological novelty beyond the existing GRN framework.
-
The paper lacks direct evidence explaining why discrete modeling improves action-vision alignment. Improvements in downstream performance do not necessarily establish the underlying mechanism, and representing both actions and visual observations as discrete tokens does not inherently guarantee stronger semantic alignment between them.
-
Although the paper emphasizes stable long-horizon generation, the main comparisons are limited to 10-second videos. It remains unclear whether the model can preserve scene consistency over longer trajectories, particularly when revisiting previously observed locations. For example, can the model accurately reconstruct an object encountered at 5 seconds when the camera returns to the same location at 20 seconds?
-
The paper does not clearly explain how the different dimensions of the camera-action descriptor are normalized before quantization. Moreover, it remains unclear whether action and visual features share the same HBQ quantization parameters or use separate quantization mechanisms.
Questions for authors
Please refer to the weakness.
- Please explain the novelty beyond the existing GRN framework.
- Please give some direct evidence explaining why discrete modeling improves action-vision alignment.
- Whether the model can preserve scene consistency over longer trajectories, particularly when revisiting previously observed locations. For example, can the model accurately reconstruct an object encountered at 5 seconds when the camera returns to the same location at 20 seconds?
- Please explain more details like how the different dimensions of the camera-action descriptor are normalized before quantization and whether action and visual features share the same HBQ quantization parameters or use separate quantization mechanisms....
If the authors adequately address the questions above, I would be willing to raise my score.