- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper introduces a position-encoding module for biomolecular structure prediction. Hidden atomic representations are linearly projected to three-dimensional virtual coordinates, which control rotary transformations of queries and keys in subsequent attention layers. The three axes use interleaved, balanced frequency schedules, with learnable frequency scaling. The paper proves relative-position consistency, norm preservation, local isotropy of the positional operator's perturbation response, and a fixed-content logit sensitivity bound. Experiments at three Protenix scales report improvements on most metrics across PoseBusters, RecentPDB, and selected PXM-Legacy subsets.
Critical strengths
- The module is conceptually compact. Using learned coordinates to modulate attention is an interesting way to inject structured relative information
- The empirical signal is promising across several settings. At 20,000 training steps, Protenix-base improves PoseBusters LDDT-mean from 63.61 to 67.34 and RMSD-distance from 11.58 to 9.82.
- Improvements also appear in aggregate RecentPDB and PXM-Legacy results and at smaller model scales.
Critical weaknesses
- The virtual-trajectory interpretation is stronger than the construction establishes. Definition 1 produces unsupervised three-dimensional projections of hidden features across attention layers. These are not shown to be physical atomic coordinates or the coordinate states of successive diffusion steps. The introduction motivates the method through denoising trajectories, while the formal definition is layerwise; the relationship between these two indices needs to be explicit. In summary, the current coordinate/trajectory is the map from the feature, which the author interprets as relative motion in the diffusion steps. The evidence linking diffusion step motion and trajector is missing. The current evidence supports more like "feature-related positional encoding is more effective. "
- Local isotropy is not full three-dimensional rotational symmetry. Proposition 2 concerns the leading quadratic term of a Frobenius-norm response to small positional perturbations. It does not establish rotational invariance of content-weighted attention logits, equivariance of the coordinate projection, or equivariance of the complete model. Even for one equal-frequency group, the exact response is proportional to the sum over axes of 1 - cos(theta * delta_axis), which is not generally a function only of the displacement norm at finite displacement. The theorem itself is appropriately local, but the broader “3D symmetry-preserving” language and Figure 3 caption need qualification. A transformation law for learned coordinates and controlled global-rotation tests would address the practical claim.
- The controls do not establish that dynamic geometry explains the improvements. Table 4 removes frequency scaling or changes axis allocation, but does not compare dynamic coordinates with fixed learned positions, random/frozen projections, current noisy coordinates, or a parameter-matched additive geometric encoding.
- Evaluation and implementation details are insufficient for interpreting the reported magnitudes. “RMSD-mean” is an average of success rates at 5, 10, 15, and 20 Å, not a mean distance. This is not a common metric used by other complex structure prediction works, as they usually use mean RMSD or dockq success rate.
Questions for authors
Which attention modules produce and consume the virtual coordinates, and how do layer indices, diffusion steps, and the virtual steps in Figure 2 correspond?
I thank the authors for providing a detailed response that addresses my main concerns. I will therefore maintain my positive score.