- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes SyncWorld, which is a view-decoupled architecture for multi-observer interactive video generation. It decouples the global state evolution and observer view rendering in the world model. The global state evolution comes from the game server itself, while an improved video-diffusion model renders the observation of each view based on the input condition from the game server. This paper also introduces a large-scale dataset collected in the CS:GO game, covering five maps. Experiments show that SyncWorld can achieve better visual quality than baselines.
Critical strengths
-
This paper gives a clear system framing that separates "who advances the world" and "who observes it". Especially, it supports varying number of observers in the inference.
-
This paper contributes a large-scale multi-observer FPS dataset with detailed annotations such as camera calibrations and actions. This open-source dataset can help the training and evaluation of other works in this community.
Critical weaknesses
-
This method relies on a stand-alone game engine to model the world states. This violates the high-level principle and motivation of world models, i.e. modeling the world evolution and dynamics. The proposed method is more like a neural render instead of world model. Besides, this significantly limits the application range of the proposed method. For example, it can never be applied to the real world.
-
Given the above weakness, one central claim, cross-view consistency, largely comes from the oracle conditions from the game engine rather than any specific designs of the model. This also makes the comparison with previous works unfair, as previous methods don't have access to the game engine and they have to model the world states by themselves.
-
The model is quite heavy with more than 14B parameters, so it is almost impossible to render multiview observation in real time. This fact makes the claim of "interactive" world model unrealistic.
-
The evaluation is conducted on a map from the training set, so the cross-map generalization ability is not demonstrated.
-
The presentation can be further improved. Currently, it is not easy to understand the method, and Figure 1 can be more clear to show the detailed architecture.
Questions for authors
Please consider replying to the weaknesses.
Clarifying the world-model scope and contribution
We thank the reviewer for raising the important question of how SyncWorld should be positioned relative to pixel-only world models. We clarify the scope of the model and the contribution below.
SyncWorld is built on LingBot-World, a pretrained video world-model backbone. Fine-tuning this backbone with structured geometric and status conditions preserves its temporally coherent video prediction and autoregressive continuation capabilities. The conditioning design determines how one shared evolving state is realized across multiple observers.
Our current setting separates two roles. The CS engine advances the authoritative state and interaction consequences, while the adapted world-model backbone generates observer-specific videos conditioned on projections of this shared state. These are different questions. The source of the state transition and the ability to generate coherent, controllable visual observations of that state need not be implemented by the same component. We therefore describe SyncWorld as a world-model-based multi-observer generation framework. We do not claim that the video model independently learns the underlying CS game dynamics from pixels.
The learned renderer is valuable because a conventional engine renderer follows predefined assets, rendering rules, and a fixed visual pipeline. A generative video renderer can produce diverse visual observations under the same structured state, including different appearances, camera styles, scene details, and prompt-controlled presentations. This is relevant to game development and interactive content creation, where reliable interactive state transitions and flexible visual generation are both important. A future extension could make the underlying 3D structure generative as well, so that both the 3D state and its video observations are generated.
The shared engine state is intentionally part of the current setting. We do not present cross-view consistency as evidence that the video model has independently learned the engine’s rules. Instead, our new metrics evaluate whether the learned renderer faithfully realizes one shared state across observers. SyncWorld obtains 0.6681 Cross-view Presence and 0.2973 Cross-view Action, while Cross-Group Shuffle obtains 0.4312 and 0.0675. The Time-Shift control obtains 0.4806 and 0.1444. These controls show that the measured consistency depends on synchronized state and correct observer grouping.
We agree that the claim of interactive operation should be supported by explicit runtime measurements. We will report latency, peak GPU memory, and total GPU cost as the observer count increases, distinguishing serial, batched, and parallel execution. If the measurements do not support real-time operation at the current model size, we will narrow the wording accordingly.
The current quantitative model evaluation is concentrated on Dust2, so we do not claim demonstrated unseen-map generalization. We will also revise Figure 1 to make the data flow explicit:
shared state evolution → observer-specific condition projection → shared video renderer
This clarification separates the capabilities supplied by the engine from those learned by the video world-model backbone and makes the intended contribution easier to assess.