- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
PhysMAS introduces a multi-agent, physics-grounded framework for generating compositional 4D Gaussian scenes. A scene agent identifies and maintains persistent object–part relationships, while a material agent infers part-wise physical properties for MPM simulation. The system supports heterogeneous multi-part objects and interacting multi-object scenes without per-scene SDS optimization. Experiments show that PhysMAS outperforms several existing methods in semantic alignment, user preference, motion consistency, and deformation quality, while ablation studies confirm the importance of object–part modeling and structure-preserving projection.
Critical strengths
This paper addresses the problem that the structures of complex objects cannot be properly separated in current simulator-driven 4D Gaussian synthesis methods, and proposes an agent-based framework to solve it. PhysMAS consists of two agents: one is responsible for identifying complex object–part identities, planning actions, and accepting the final results, while the other determines the physical parameters of each part. Compared with SDS-based methods, PhysMAS achieves substantially faster inference.
Critical weaknesses
The entire system relies on Grounding DINO and SAM 2 to segment object parts. Errors at this stage can propagate to material prediction and subsequent MPM simulation. Does the paper provide any robustness analysis for segmentation errors? Compared with SDS-based methods, PhysMAS may have limited ability to correct such errors once the initial part assignments are incorrect.
The candidate screening process and predefined material categories incorporate substantial human priors. This makes the method appear more like an application of agents to 3D material styling than a fundamentally new physics-based approach. Compared with SDS-based methods, PhysMAS may also exhibit a noticeable gap in physical realism, with its main advantage being efficiency. The qualitative analysis mainly demonstrates relatively simple object transformations, such as rigid objects falling. More complex cases may produce implausible results. For example, in the flowerpot example shown on page 29 of the appendix, the flowerpot falls while the grass remains static, which appears physically unnatural.
Questions for authors
How does the agent handle severe occlusion or incomplete visual evidence? For example, how would it reason about a piece of dough wrapped around or enclosing a stone when the internal structure cannot be directly observed?