- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
CompAdapt addresses physics-consistent text-to-video generation involving parallel motions, sequential transitions, and object collisions. It parses text into structured motion sequences and initial physical states, composes pretrained Neural Newtonian Dynamics modules, handles collisions through a dedicated interaction module, and conditions video generation on the resulting physical states. For unfamiliar physical environments, it selects a pretrained dynamics prior using a reference trajectory and performs regularized one-shot adaptation. The central claims are that elementary dynamics modules can be composed into physically consistent complex motions and adapted to unfamiliar dynamics from a single observation.
Critical strengths
-
The problem is meaningful. Extending physics-guided video generation beyond isolated motion types to concurrent motions, temporal transitions, and collisions addresses a substantial limitation of existing approaches.
-
The system decomposition is conceptually reasonable. Separating continuous dynamics from collision-induced discontinuities is well motivated. Introducing mass explicitly also addresses an important distinction between single-object kinematics and multi-object interactions.
Critical weaknesses
-
The primary metric does not establish that the intended physical process is generated correctly. The most consequential concern is the validity of the evaluation. PIS in Eq. (21) measures the relative temporal stability of a selected quantity. It does not directly verify the correct physical parameter, initial condition, or governing equation. For example, when acceleration is the monitored quantity, an incorrect but constant gravitational acceleration can receive a perfect score. Moreover, an identically zero monitored quantity also receives a perfect score under Eq. (21), potentially rewarding degenerate outputs that fail to exhibit the requested motion. Table 9 demonstrates this limitation: for Oscillating size, the ground-truth trajectory receives a GT-PIS of 0.106, whereas the adapted model receives 0.955. Appendix E acknowledges that this case illustrates metric behavior rather than adaptation quality, yet the scenario remains included in the near-domain aggregate. The table also describes GT-PIS as an attainable upper bound, although model scores exceed it in several cases. Consequently, the reported results do not adequately distinguish correct target dynamics from trajectories that merely keep the monitored quantity stable. Target-equation residuals, parameter errors, trajectory errors, and collision conservation errors are needed. The paper should also distinguish measurements on predicted state trajectories from measurements extracted from the final generated videos.
-
The theoretical exactness claims do not establish the correctness of the implemented trajectory composition. Equation (6) combines independently generated trajectories after subtracting a shared force-free trajectory. Appendices C and H claim that this construction is also exact for affine-linear dynamics acting on shared coordinates. However, solutions of different linear dynamical systems cannot generally be composed by adding their independent rollouts. Consider constant acceleration combined with linear drag: The acceleration-only module produces . The drag-only module, starting from rest, produces , and the force-free velocity is also zero. Equation (6) therefore gives whereas the correct combined solution is: This counterexample involves entirely linear dynamics. The superposition argument in Eq. (15) requires responses governed by the same system matrix , which is not established for the different category-specific pretrained modules used by the method. Recomputing the composition at sufficiently small time steps could yield an approximation, but would require a corresponding numerical analysis rather than a general exactness claim. A related gap concerns collisions. Equations (17)–(19) establish conservation for an analytical impulse map, while the main method describes a learned collision module. Showing that a network can represent a conserving map does not establish that the trained network necessarily conserves those quantities. The claim of “guaranteed physical consistency” therefore exceeds the demonstrated guarantees.
-
The reported comparisons do not establish the benefit of one-shot adaptation In Table 9, the adapted Var-PIS is lower than the prior-matching-only ZS-PIS in 32 of 34 scenarios. Examples include: Standard deceleration: 0.997 → 0.574, Combined lunar gravity, low friction, and size change: 0.998 → 0.904, Tight spiral: 0.700 → 0.459. Given the metric limitations discussed above, these decreases do not necessarily imply worse physical accuracy. Nevertheless, they show that the paper’s own primary metric does not establish the benefit of adaptation. The main discussion emphasizes the absolute post-adaptation scores without adequately explaining this systematic decrease. Furthermore, 22 of the 34 controlled scenarios involve parameter shifts, while the average score for structurally unfamiliar far-domain scenarios is only 0.515. The evidence is therefore stronger for adjustment within existing dynamics families than for broad adaptation to unfamiliar physical laws. The three real-video experiments also leave the independent testing and calibration protocols insufficiently specified. It remains unclear whether adaptation identifies transferable environmental dynamics or primarily fits the observed motion.
-
The experimental controls do not isolate the contributions of the proposed components The ablations in Table 2 replace all parallel motions with sequential execution or all sequential motions with synchronous execution. These comparisons demonstrate that respecting the requested temporal relationships matters, but do not establish that the proposed composition rule is superior to other reasonable composition methods. A more informative comparison would hold the parser and video generator fixed while replacing the proposed dynamics composition with joint integration, an analytical physics solver, or simple parameter identification. The video-generation comparison is also confounded: the proposed generator is fine-tuned on task-specific data, whereas Table 3 compares it against untuned Wan-Move. The reported gains therefore cannot be attributed specifically to spatial warping and adaptive blending. Additionally, describing Wan-Move’s feature propagation as supporting only translation is too restrictive. The original method uses dense point trajectories and demonstrates rotation control; different point trajectories can collectively encode rotation. A comparison using equivalent motion information and matched training data is necessary to establish the added value of the proposed rendering components.
Questions for authors
Refer to Critical Weaknesses