- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates whether learning from protein-folding-derived supervision can improve the broader reasoning capabilities of language models. The authors introduce FoldingCorpus, a collection of structural question-answer pairs derived from protein data, and propose Fold2Reason, which combines language-model adaptation with auxiliary geometric supervision. Experiments across spatial, graph, scientific, and general reasoning benchmarks suggest that this training yields transferable performance gains beyond the protein domain.
Critical strengths
1. The paper presents an interesting empirical finding. Post-training on protein-structure-derived supervision improves performance across several reasoning benchmarks beyond the protein domain.
2. The empirical investigation is broad and transparent. The paper evaluates multiple model scales and families, several data scales, component ablations, control tasks, and multiple random seeds. It also analyzes output validity, task-level gain concentration, and structural decodability, while openly discussing several limitations.
Critical weaknesses
1. The current experiments do not establish that the protein-folding origin of the supervision is responsible for the observed transfer. FoldingCorpus provides meaningful, input-dependent structured supervision, but a similarly constructed task such as synthetic graphs or 3D point clouds may also produce comparable gains. The existing controls are not matched alternatives: shuffled labels remove the input-label relationship, format copying is substantially easier, and hidden geometry is input-independent. This issue is consequential because it directly weakens the paper’s central protein-folding-specific claim.
2. The evidence for the proposed geometric mechanism is limited. Removing the geometry objective preserves most of the reported improvement, while the incremental Full-minus-no-Geometry gain is small and its confidence interval spans zero. Moreover, the task-level decomposition shows that a substantial fraction of the gains on FTB-Core and SpatialViz comes from a small number of tasks where the base model exhibits strong answer-selection biases. Although the paper’s validity audit suggests that parsing failures alone do not explain the improvements, it remains difficult to separate improved geometric reasoning from improved answer calibration.
Questions for authors
- Could the authors add a matched non-protein control task, such as synthetic graph reasoning or 3D point-cloud reasoning, with comparable data scale, input complexity, and supervision format? Without such evidence, the observed improvements may be attributed to structured QA post-training rather than specifically to learning protein folding.
- The authors should rerun the main multiple-choice evaluations using option-order randomization, candidate log-likelihood ranking, or constrained decoding to determine whether the reported gains remain after controlling for answer-selection bias.
- Figure 3 shows that the gains diminish as model size increases within the Qwen3.5 family, while Gemma-4-12B shows almost no improvement. Could the authors evaluate a larger model from the same family to determine whether this diminishing trend reflects a scaling limitation rather than architecture dependence? If the transfer effect becomes negligible for larger and more capable models, the practical significance and generalizability of the proposed approach would be substantially limited.
Dear Reviewers,
As the discussion period draws to a close, please read and acknowledge the authors’ rebuttal within the next 24 hours. I also encourage you to engage in the discussion and share any remaining questions or concerns.
Thank you for your time and thoughtful reviews.
Best,
Your AC