- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes DISCO loss, a jointly trained auxiliary distogram-prediction module for protein inverse folding. Logit-derived single/pair representations and frozen ESM-2 features predict the target-backbone distogram, providing structural supervision without folding-model feedback during training. The auxiliary module is removed at inference. Experiments on ProteinMPNN, PiFold, and Grade-IF report improved structural consistency on RFdiffusion-generated backbones under AF2 and ESMFold, together with contact, secondary-structure, recovery, diversity, amino-acid-composition, and Rosetta-energy analyses.
Critical strengths
The auxiliary target fits the task and adds no inference-stage module. The distogram is available from the conditioning backbone, and joint training avoids a separately pretrained structural surrogate or folding-model feedback. Several complementary evaluations support empirical benefits. The paper uses AF2 and ESMFold, paired confidence intervals, and comparisons with AFDistill and a FAPE-based variant. Appendices further analyze long-range contacts, secondary-structure recovery, composition, diversity, and Rosetta energies, and report model-dependent recovery losses rather than presenting uniformly positive outcomes.
Critical weaknesses
The methodological contribution is incremental, and the motivation does not directly establish the failure mode being addressed. The auxiliary module adapts established distogram-prediction components to inverse-folding supervision. Its main contribution is the jointly trained, removable structural head, so evidence connecting it to actual inverse-folding errors is important. Figure 1 instead uses native sequences with 10% random substitutions. Such substitutions need not reflect correlated, context-dependent model errors, and the description does not adequately specify backbone selection, sample size, or substitution details. A matched-recovery analysis of actual model outputs would more directly establish the motivating problem. The recovery–structure trade-off and broader applicability remain insufficiently characterized. Table 3 reports a 3.88-point CATH recovery decrease for ProteinMPNN and recovery decreases for Grade-IF on the three full benchmarks, while PiFold improves. Appendix C.1 already sweeps temperature and loss weight, but evaluates structural gains on de novo backbones, while recovery is measured separately on natural-protein benchmarks. Appendices D.1–D.2 and G identify improvements in contacts, secondary structure, composition, and Rosetta energies. The remaining gap is a joint recovery–structure analysis across objective weights on held-out native backbones, where both metrics are defined. Lower native recovery is not itself evidence of worse design; a joint analysis would clarify the available trade-off. Evaluation is restricted to single-chain designs, and applicability to additional strong inverse-folding backbones is not established. These limitations constrain the significance of an otherwise useful incremental training objective.
Questions for authors
-
Figure 1 protocol and applicability of the motivation: Could you detail the procedure behind Figure 1, including the sources of native sequences and backbones, sample size, position selection, substitution rules, and structural evaluation settings? At matched recovery, are the patterns of structural quality consistent between controlled mutations of native sequences and actual model-generated sequences? This comparison would help establish whether the motivation extends to practical inverse-folding outputs.
-
Causes and implications of reduced recovery: Could you analyze why adding DISCO reduces recovery for some models? Are these changes accompanied by improved structural consistency on the same targets, or are there cases where both recovery and structural quality decline? Paired results and representative examples, building on the existing composition and structural analyses, would help distinguish a beneficial design trade-off from a loss of sequence-prediction capability.
Dear Reviewer,
Thank you for highlighting both the strengths of our work and the areas where it could be improved. We appreciated hearing that you found the paper clear, easy to follow, and informative. Your feedback also helped us see where our reasoning needed stronger support. In our rebuttal, we focused on the concerns about soundness that you identified as minor or fixable and provided additional evidence and clarification in response. We were encouraged that another reviewer raised their score after considering our responses.
When you have a chance, we would be grateful to hear whether our additional evidence and clarifications address the concerns you raised. We would be happy to discuss any points that you feel would benefit from further clarification.
Best regards,
The Authors