- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
In this paper, the authors investigate isofunctional protein rewriting, which modifies a protein sequence through compression, expansion, or paraphrasing while attempting to preserve its function. A non-autoregressive editing model, ISOFORM, is introduced and evaluated with operation-specific budgets and a set of computational proxies. The main finding is that retaining annotated functional sites does not necessarily imply preservation of the protein's structural organization or function. In addition, the paper reports that the composite rankings are sensitive to metric weights. The authors acknowledge that the evaluation relies on computational proxies rather than biochemical measurements.
Critical strengths
- The paper raises an evaluation question and provides an experimental framing. The comparison framework attempts to hold the editing budget fixed across methods and includes feasibility checks.
- The experimental results are reported, and several findings are discussed.
Critical weaknesses
- The current experimental results can not establish that ISOFORM reliably preserves function or consistently outperforms baselines. The primary compression comparison is mixed, the aggregate result is not statistically significant, and the evaluation depends heavily on proxy metrics whose relationship to biochemical function remains uncertain.
- The aggregate score utilize fixed weights, and the paper reports that changing these weights can reverse the ranking, which means the comparison depends on a choice of evaluation priorities that may not have a uniquely justified answer. It would be better to supplement the composite with a Pareto analysis, sensitivity plots over a broader range of weights, and a clear justification for normalization and weighting.
- The experimental findings demonstrate a multi-objective trade-off. Since the test set only have 40 held-out proteins, it important to describe the diversity.
Questions for authors
Please refer to the weaknesses.