- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies whether low-order experimental measurements can be used to prioritize unseen higher-order protein variants. The authors formulate a two-to-many inverse-folding setting in which training uses only wild-type, single-mutant, and double-mutant fitness measurements, while evaluation is performed on variants with three or more mutations. PIF constructs preference pairs from measured low-order variants and synthetic higher-order negatives generated from inactivity-associated mutations. It further augments ProteinMPNN and ESM-IF representations with ESM2 residue embeddings through a FiLM module and applies preference optimization only at mutation sites that differ between paired variants. The method is evaluated on four FLIP2 protein fitness datasets using both inverse-folding backbones. Results are reported with top-K retrieval, enrichment, ranking metrics, and standard inverse-folding metrics, together with ablations for synthetic negatives and foundation-model conditioning.
Critical strengths
-
The evaluation is reasonably broad, covering four FLIP2 protein fitness datasets with different assay types and two inverse-folding backbones, ProteinMPNN and ESM-IF. This reduces the chance that the reported gains are tied to a single protein or model architecture.
-
The low-order-to-high-order setting is practically relevant for protein engineering, since experimentally characterizing single and double mutants is much cheaper than exhaustively assaying higher-order combinations. The paper evaluates this setting directly rather than relying only on standard inverse-folding recovery metrics.
Critical weaknesses
-
The methodological novelty is limited and the positioning against prior preference optimization work is incomplete. The framework is closely related to FPA, and the paper explicitly adopts its FiLM-based functional conditioning and critical-site preference alignment. The main additional component is therefore the construction of cross-order preference pairs rather than a substantially new optimization framework. Moreover, the related-work discussion omits several closely related preference-based protein design methods, including InstructPLM-DPO [1], EnerBridge-DPO [2], CAPE-MPNN [3], and ProtAlign [4]. These works already apply preference optimization to inverse folding or protein sequence design using structural, energetic, or functional signals, which makes the incremental contribution of PIF less clear.
-
The synthetic higher-order negative construction is empirically useful, but its underlying assumption is not sufficiently validated. The method assumes that recombining mutations associated with low-activity low-order variants produces useful higher-order negatives, even though the authors acknowledge that their actual fitness is unknown and may be affected by epistasis. The ablations show that these negatives improve downstream retrieval, so the strategy is clearly useful as a training heuristic; however, the paper does not measure how often the synthesized variants are actually lower-fitness than their paired positives, despite the FLIP2 benchmarks containing measured higher-order variants that could support such a check. This makes it difficult to tell whether the gain comes from biologically meaningful cross-order supervision or simply from a useful form of hard-negative regularization.
[1] Xu, Junde, et al. "Protein inverse folding from structure feedback." Advances in Neural Information Processing Systems 38 (2026): 24274-24299.
[2] Rong, Dingyi, et al. "EnerBridge-DPO: Energy-Aware Markov Bridge Inverse Folding for Protein Sequence Design." Journal of Chemical Information and Modeling 66.15 (2026): 9709-9720.
[3] Gasser, Hans-Christof, et al. "Tuning ProteinMPNN to reduce protein visibility via MHC Class I through direct preference optimization." Protein Engineering, Design and Selection 38 (2025): gzaf003.
[4] Liu, Junqi, et al. "Property-driven protein inverse folding with multi-objective preference alignment." International Conference on Learning Representations. Vol. 2026. 2026.
Questions for authors
-
Could the authors clarify the main methodological difference between PIF and FPA, given that the proposed framework adopts FPA-style FiLM conditioning and critical-site preference optimization? It would also help to position PIF more explicitly against other recent preference-based protein design methods.
-
The synthetic higher-order negatives improve downstream retrieval in the ablation, but their true fitness is unknown. Since the FLIP2 datasets contain measured higher-order variants, can the authors report how often the synthesized negatives that can be matched to measured variants are actually lower-fitness than their paired positives? This would help determine whether the gain comes from meaningful cross-order supervision or mainly from hard-negative regularization.
-
Are synthetic higher-order sequences that exactly coincide with held-out test variants removed from the training preference set? This is particularly important for dense combinatorial datasets such as TrpB.
Response to Reviewer mkbp
Thank you for the detailed assessment.
W1 / Q1. Difference from FPA and other preference-based methods
One clarification regarding FPA: FPA does not use FiLM-based foundation-model conditioning. Our contribution is not a new preference-optimization objective, but a framework designed for two-to-many protein inverse folding.
We have also clarified "critical sites". In FPA they are chosen in advance from hypotheses about functional importance; in PIF the set is defined per preference pair as the positions where the two variants differ. Since all other residues are shared, these carry the mutation-specific signal behind the measured activity difference. This is now explicit in the revision.
Missing related work. We thank the reviewer for pointing out InstructPLM-DPO, EnerBridge-DPO, CAPE-MPNN and ProtAlign, which we add to Section 2. Their training signals differ from ours: InstructPLM-DPO uses folding-model structural feedback, EnerBridge-DPO energy-based preferences, CAPE-MPNN MHC-I visibility, and ProtAlign multi-objective property alignment. In each case the signal is evaluable at training time for an arbitrary sequence, so preferences can be generated on demand anywhere in sequence space. In our setting no such signal exists: activity is known only for a small low-order set, and the regime we must rank is unmeasured by construction. We revise the related-work section around this distinction rather than listing methods.
W2 / Q2. How often are the synthesized negatives actually lower-fitness than their paired positives?
We do not assume every recombinant remains inactive under epistasis; the construction is intended to make it more likely to have lower activity than its paired positive, providing a useful ordinal preference.
We test this over the full measured higher-order set, grouping all 265,686 measured 3+ mutants across the four datasets by how many inactivity-associated pool substitutions they carry. "Pool substitutions carried" is not the mutation count: it is how many of a variant's substitutions lie in the 25-substitution inactivity pool. IRED is for reference only: its negatives are measured inactive variants from the source publication, not recombinants.
The relationship is monotonic on all four datasets. One pool substitution reduces the fraction exceeding WT from 23.35% to 2.31% on NucB, 3.59% to 0% on Amylase and 0.51% to 0% on TrpB; IRED shows a weaker but consistent trend. Inactivity-associated mutations identified independently from training and from held-out higher-order data also overlap substantially, indicating these patterns transfer to higher-order backgrounds rather than being artifacts of the training split.
Q3. Do synthetic higher-order sequences coincide with held-out test variants?
We measured this overlap directly.
Synthetic negatives are essentially disjoint from the evaluation pool: the overlap is zero for Amylase, IRED and NucB, and for TrpB only 5 of 2,592 (0.19%) coincide with measured test variants, or 0.0023% of the test pool. All five are genuinely low-fitness (mean activity −0.061 against a test-pool mean of +0.033) and therefore satisfy the intended negative preference.