- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies protein MD trajectory generation and proposes VideoMD, which renders each trajectory into a fixed-resolution, fixed-length 2D video tensor and fine-tunes a pretrained image-to-video diffusion model (Wan + LoRA) to generate future frames conditioned on the first rendered frame and a simulation-protocol text prompt. The main claims are competitive ensemble/temporal statistics on ATLAS under a new video-based protocol (MoViE) and inference cost largely decoupled from protein length.
Critical strengths
-
A new formulation of MD trajectory generation as conditional video prediction (Sec. 3.1). Representing a trajectory as a fixed-resolution, fixed-length video tensor and modeling is a clean reframing that lets the method reuse pretrained video generators rather than building a molecular-specific backbone.
-
Evidence that generated videos carry recoverable motion information (Table 2). Under a frozen structure-conditioned decoder, generated videos outperform repeated-first-frame and shuffled-input controls across five coordinate metrics, supporting that temporal content in the video is informative beyond the static initial frame.
-
A video-native, structure-aware evaluation protocol. Two CLIP-based predictors estimate structural invalidity and pairwise RMSD from rendered videos alone, with reported predictor error and threshold-classification metrics, covering structural validity, ensemble statistics, and temporal dynamics.
Critical weaknesses
W1 . The decoder is trained on paired rendered MD videos and coordinates, uses initial , sequence, ANM priors, and geometric/dynamical losses, and is frozen before evaluation (App. F, F.4). It does not access Wan VAE/DiT features (App. F.1). No weak-decoder ablation, no generator-quality sweep, and no error decomposition are reported. Table 2's controls (repeated first frame, shuffled input) show video content matters, but cannot quantify how much capability comes from video learning versus decoder priors. The paper itself states the gap "reflects the combined effects of video generation and recovery" (Sec. 4.5).
W2 . Input is one fixed-view frame with NewCartoon rendering (Sec. 3.2, App. A.1). Side chains are not rendered, so drug-binding/active-site conformational changes are largely invisible. No multi-view input, no occlusion analysis, and no site-specific metric are reported. The paper acknowledges the single-view depth limitation (App. F.3) but does not test whether multi-view snapshots would help.
W3 . No training wall-clock time or GPU-hours are reported, and no comparison with baselines' training cost.
W4. All generation uses a fixed spatial size; rendering uses then a content-aware crop; MoViE predictors use . No resolution ablation is reported: no comparison of vs. lower/higher resolution, no per-length-bin resolution sensitivity, and no quality–cost trade-off curve. This matters because (i) coordinate/graph-based baselines operate in coordinate space and have no rendering-resolution issue, making the comparison asymmetric; (ii) at a fixed grid, a 51-residue and a 724-residue protein occupy very different pixel footprints, yet Fig. 3c bins by length without controlling for resolution; (iii) the "size-decoupled" efficiency claim (Fig. 3c, Table 14) holds only at fixed resolution—attention/VAE cost typically scales with pixel/token count, and no such scaling is reported.
Overall, casting MD as video learning is interesting and offers a new paradigm, but I am not convinced the video representation is necessary. Because a separately trained decoder converts the 2D video back into coordinates, it is hard to tell whether gains come from the video carrying better dynamical information or from the decoder obtaining a stronger representation. Coordinate/GNN baselines' latents can also contain reasonable dynamical information—they are just less human-interpretable—so the paper does not establish what video adds beyond such latents or why image space is better for MD. Video also introduces a resolution constraint absent in coordinate models, and training efficiency relative to GNN baselines is not reported. I do think video has potential and can encode 3D information, but only a single-view snapshot is used, making this potential hard to see. I would encourage the authors to add (a) an explicit discussion of when and why video modeling should be preferred over latent coordinate representations, and (b) mechanism-level experiments isolating the video contribution.
Questions for authors
- Can you provide a weak-decoder or decoder-frozen-vs-retrained ablation to separate generator contribution from decoder priors? Alternatively, sweep generator quality (e.g., no-LoRA, fewer steps) and report whether coordinate metrics track video quality monotonically?
- Can you report training cost (GPU-hours/wall-clock) for VideoMD and baselines, and a matched-hardware end-to-end timing from first frame to final coordinates, including decoder/refinement/backmapping?
- Can you report a resolution ablation (e.g., , , higher) on MoViE and coordinate-recovery metrics, together with inference time, and compare against coordinate baselines at matched quality rather than matched nominal setting?
- Would multi-view input improve coordinate recovery or MoViE? At minimum, can you quantify the occluded-residue fraction in the input view?
- Can you provide any energy-based or thermodynamic check (free-energy surface comparison) to support physical plausibility?
- How sensitive are results to the content-aware crop and rendering choices (NewCartoon, coloring, material), and to the single fixed camera?