- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors introduce temporal triangular attention, inspired by the triangular attention used in Alphafold-style models. This is in particular to the application for molecular dynamics simulations where currently deep learning models compress the trajectory into a single embedding and do not capture the residue-pair representations. The authors incorporate the temporal triangular attention into ProTTA, an Evoformer-style encoder, where it replaces the triangular attention. ProTTA is evaluated on mdCATH and ATLAS molecular dynamics datasets for dynamics forecasting and function prediction results.
Critical strengths
-
The paper is well written, easy to understand and follow with a clear schematic describing the architecture.
-
The development of the temporal triangular attention for molecular dynamics accounting for the time frame as well is interesting and novel.
-
Experiments across mdCATH and ATLAS which are popular MD datasets show the robustness of the model, and competitive performance against the baselines make the results stronger.
Critical weaknesses
-
The metrics for forecasting report JSD, recall, F1, and RMSD. However, the physical and structural validity of the generated molecules is not checked. These could be done using metrics such as Ramachandran outlier rates and clash scores which would show whether the forecasted conformations are physically plausible.
-
Additionally, from Table 4, it looks like ConfRover outperforms ProTTA on every reported metric (JSD, recall, F1, and RMSD) which overstates ProTTA’s results.
Questions for authors
-
Have the authors considered structural validity metrics such as Ramachandran outlier rates and clash scores?
-
Have the authors considered other tasks such as ensemble generation or energy-based path generation? It could be interesting to look at considering the emphasis on a good representation for molecular dynamics trajectories.
2 comments
Thank you for the responses. I maintain my positive score. Best of luck!
Thanks for the insightful comments, and we kindly address them as following:
Comment: Physical and structural validity of forecasted conformations.
We agree that distributional metrics alone do not establish physical plausibility. In the current work, ProTTA operates on Cα coordinates only. Both the trace embedding and the forecaster represent each residue by its Cα atom, and the training objective (EDM denoising of Cα displacements, plus a Cα–Cα bond-length term) is defined at that level. Backbone-level metrics such as Ramachandran statistics require backbone dihedrals, which a Cα-only model does not produce. However, these additional properties can be added incrementally. We also note that many protein structure generation models operate on the pair representation, which is the main feature in our architecture, thus extending to all atom structure models can be achieved. We therefore see this work as a deliberate first, incremental step. It provides evidence, at the Cα level, that extending the triangle mechanism across time helps model molecular dynamics, both for function prediction and for forecasting.
Comment : Comparison to ConfRover
We acknowledge that ConfRover outperforms ProTTA, and we did not intend to claim otherwise. Our claim, in lines 86–88, is that “ProTTA reduces forecasting RMSD by 20% relative to MD-only baselines and comes within reach of sequence-conditioned ones without access to sequence.” We position ProTTA as an MD embedding model. Designing a way to incorporate sequence into dynamics forecasting is non-trivial and well beyond our scope, so we keep ProTTA MD-only for this task.
Comment: Ensemble generation and energy-based path generation.
Ensemble generation is the similar of the two to our current setup. Our forecasting evaluation already treats rollouts as ensembles: it reports JSD between coordinate distributions, and our released evaluation code also computes pairwise-RMSD distributions and Wasserstein distances. Our multi-start protocol also samples many rollouts per protein.
The other tasks, like energy-based path generation, mentioned by the reviewer require a different generative objective and evaluation, and we list it as future work. We appreciate the suggestion and will pursue it in follow-up work.