- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes Physics-Consistent Self-Correction (PCSC) to address noisy training labels in de novo peptide sequencing. The method combines a neural sequencer with a fixed spectrum peptide matcher, iteratively generating candidate peptides, replacing current labels with higher scoring predictions, and retraining models from scratch. Experiments show improved reference sequence recovery and peptide recall on an independent nine-species benchmark under synthetic label corruption, with further performance improvements observed using a large-scale corpus of real-world PSMs and an autoregressive model.
Critical strengths
-
The authors address the practically important problem of noisy training labels in de novo peptide sequencing. Using fragment evidence from experimental spectra to assist label correction is a reasonable idea that fits the task.
-
The authors propose a simple and intuitive method that combines neural candidate generation with fixed spectrum–peptide matching. The method naturally incorporates mass spectrometry domain knowledge and can be applied to different sequencing models.
-
The authors report higher final peptide recall than the evaluated robust learning and confidence-based label update baselines under synthetic label corruption, alongside improvements in label recovery and fragment matching. Preliminary experiments help explain model behavior under noisy supervision, while tests on real-world data and an autoregressive model provide additional support.
Critical weaknesses
-
The methodological novelty is limited. PCSC mainly combines neural candidate generation, fixed spectrum–peptide scoring, label replacement, and iterative retraining. The authors do not clearly establish what substantive new mechanisms or generalizable insights this combination offers beyond existing self-training and label correction frameworks.
-
The authors do not sufficiently justify the method’s key design choices or discuss its relationship to existing label correction and candidate rescoring methods. Higher matching scores do not necessarily imply more accurate labels. It remains unclear why the method uses only one candidate per spectrum, accepts any positive score difference, and repeatedly retrains from scratch.
-
The baseline comparisons are insufficient. The robust learning baselines mainly come from older work, and their adaptation and tuning are not adequately explained. PCSC achieves 0.3970 peptide recall versus GCE’s 0.3790, but uses initial training plus four retraining rounds, whereas GCE is trained once. Although confidence-based updates are compared over the same number of rounds, recent robust learning methods, budget-matched robust learning baselines, and simple score-based filtering, weighting, or candidate reranking alternatives are missing.
-
The practical benefits are not sufficiently validated. The authors do not establish that the synthetic perturbation types and proportions reflect real database search errors. On real-world annotated data, the unweighted mean peptide recall across nine species improves by only about 0.13 percentage points, with declines in some species. The PTM experiments report improved matching scores and matched peak counts without independent validation of sequence or modification-site accuracy.
Questions for authors
-
How well does PCSC recover labels for peptides without any correctly labeled PSMs in the training set, compared with peptides that have other clean PSMs?
-
Is there evidence independent of the matching score that label updates yield net corrections on real world data, accounting for originally correct labels that are incorrectly replaced?
-
Does PCSC retain its advantage over GCE and other robust learning baselines under comparable total training budgets?
-
What additional gains does multi-round retraining provide over score-based filtering or weighting, or single round label refinement using multiple candidates?
-
How does PCSC compare with representative noisy label learning, label correction, or sequence self-training methods from the past two years? If these methods are inapplicable, please explain why.
There is no rebuttal submitted for this paper. I will maintain my original rating.