- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
SceneWeaver proposes a 3D-native framework for image-to-4D generation. Instead of generating a video and reconstructing 3D afterward, it builds an explicit 3D world and synthesizes dynamics directly within it. The framework uses a Coordinator–Executor–Verifier architecture: an LLM Coordinator translates the prompt into trajectory control, fine-grained motion description, and environmental conditions; a Global Trajectory Executor uses a potential-field-augmented Neural ODE with SDF-based terrain constraints; a Local Locomotion Executor uses an LLM planner to produce joint-level articulated pose edits; and a Verifier checks trajectory, local motion, and composed scene, triggering targeted repair. Experiments use a 60-sample WorldScore-derived benchmark against image-to-4D and video generation methods.
Critical strengths
1.Well-motivated 3D-native formulation. Generating dynamics directly in an explicit 3D world is a sensible alternative to video-first 4D generation, offering better geometric consistency, controllability, and physical grounding.
2.Useful motion decomposition. Separating global world-space trajectory from local articulated locomotion is a clean design that allows independent control over “where” and “how” the subject moves.
3.Closed-loop verification and targeted repair. Maintaining structured intermediate 3D states and repairing only the responsible stage is a promising agentic paradigm, more efficient than full regeneration.
4.Physical/geometric grounding. The Neural ODE with learned residual physics, SDF terrain potential, and environmental conditions is technically reasonable and more interpretable than purely latent video dynamics.
Critical weaknesses
1.Critical presentation failure. Table 1 is garbled and missing numerical results for most metrics. The main quantitative claims cannot be verified. As presented, the paper’s central empirical evidence is unreadable.
2.Insufficient experimental scope. The benchmark has only 60 samples derived from WorldScore. There is no evaluation on standard 4D generation benchmarks, no ground-truth physical metrics (e.g., contact, momentum, penetration rates), and no failure/repair statistics.
3.Baseline fairness is unclear. Video generation methods are not designed for explicit 3D control, while image-to-4D methods may be limited in motion range. Comparisons lack compute-matched analysis, and other 3D-native or agentic 4D methods are not compared.
4.Heavy dependence on external models. SAM3, Stable Diffusion Inpaint, Hunyuan3D, AniGen, and GPT-5.6 sol are all used. Error propagation across this pipeline is not analyzed, and reproducibility is questionable without a clear code/model release.
Questions for authors
Please see weakness