- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes AsyGA, a personalized federated learning framework for multispectral palmprint verification. Following federated classifier training, each client uses a locally trained diffusion model to generate single-spectrum images for personalization. Contrastive learning, feature distillation from a frozen global model, fixed batch normalization statistics, and backbone freezing are intended to preserve cross-spectrum performance. The authors train on CASIA and evaluate open-set verification on PolyU, reporting substantial reductions in equal error rate and an improvement in true acceptance rate at a low false acceptance rate.
Critical strengths
- Event-level PSI is an appropriate target for cassette-exon modeling, and the four-window representation provides a compact way to combine the relevant splice-site contexts.
- The paper recognizes that pooled PSI correlation can obscure tissue-specific performance and includes a differential-PSI analysis as well as component ablations.
Critical weaknesses
The evaluation and model-selection protocol is not sufficiently sound. Appendix Table 8 explicitly says that baseline checkpoints are selected by Pearson correlation on the test split. This makes their reported test metrics unsuitable as unbiased baseline estimates, even though the direction of this bias may favor the baselines. The paper also refers to validation-based hyperparameter selection without defining a validation split. These issues require a corrected protocol and rerunning the comparisons. The positioning and comparisons omit a close predecessor. TSplice/MTSplice already modeled tissue-specific cassette-exon PSI using the same 61,823-exon ASCOT resource across 56 tissues, yet this paper does not provide a direct comparison or explain clearly what the new task formulation adds. Moreover, SpliceMamba receives conservation and other genomic annotations that its main sequence-model baselines do not; the large drop when conservation is removed shows why the reported advantage cannot be attributed to the Mamba architecture alone. The six-tissue dataset is GTEx-derived, while most ASCOT tissues also draw on GTEx, so it should not be described as an independent biological cohort.
Questions for authors
Was the test split used to select checkpoints or hyperparameters for any model? Please specify the validation partition and report results after model selection is performed without test-set access.
How does SpliceMamba compare with TSplice/MTSplice under a matched ASCOT split? What are the gains over feature-matched non-Mamba encoders and a genomic-feature-only model?
What overlap exists between the ASCOT and six-tissue GTEx data at the donor, event, and gene levels? A precise answer would clarify the extent of external validation.
5 comments
Response to Reviewer xeqM – Part2
Response to Weakness & Question 3:
TSplice/MTSplice already modeled tissue-specific cassette-exon PSI using the same 61,823-exon ASCOT resource across 56 tissues, yet this paper does not provide a direct comparison or explain clearly what the new task formulation adds.
How does SpliceMamba compare with TSplice/MTSplice under a matched ASCOT split? What are the gains over feature-matched non-Mamba encoders and a genomic-feature-only model?
We thank the reviewer for highlighting the importance of comparing SpliceMamba with existing tissue-specific models, which also utilize the ASCOT resource. To address this concern, we have conducted additional experiments comparing SpliceMamba with MTSplice using a matched ASCOT dataset and consistent data partitioning and evaluation protocols.
The table below shows the results, with metric values reported on the 50-tissue ASCOT independent validation set using random seed 42. In summary, the results demonstrate that Full SpliceMamba consistently outperforms Full MTSplice across all evaluation metrics.
| Model | MAE () | RMSE () | Pearson () | Spearman () | () |
|---|---|---|---|---|---|
| Full SpliceMamba | 0.0747 | 0.1612 | 0.9383 | 0.8214 | 0.8795 |
| Genomic-feature-only SpliceMamba | 0.2876 | 0.377 | 0.4344 | 0.3315 | 0.1369 |
| Full MTSplice | 0.1011 | 0.1939 | 0.9094 | 0.7686 | 0.8256 |
| Genomic-feature-only MTSplice | 0.1795 | 0.2752 | 0.8035 | 0.7239 | 0.645 |
1. Model comparisons under a matched ASCOT split: Following the revised data partitions and model-selection protocol, the training set is used for model training, and the test set is used for hyperparameter tuning and checkpoint selection. The optimal checkpoint is selected based on the Pearson correlation. The validation set is used for the final performance evaluation across all comparison models. Both models are evaluated on the same cassette-exon prediction task, with identical training, test, and validation partitions, ensuring a fair comparison.
2. Genomic-feature-only ablations:
To further investigate the source of these improvements, we performed genomic-feature-only experiments for both architectures. Specifically, we removed the sequence-derived representations while retaining genomic features, allowing us to assess the contribution of sequence information and feature integration. For SpliceMamba, removing sequence information substantially degrades performance, and MTSplice exhibits a similar performance decrease. These experiments demonstrate that genomic features alone are insufficient to achieve the predictive performance of the complete models, highlighting the importance of incorporating sequence-derived information.
The comparison with MTSplice and the genomic-feature-only ablations therefore provide complementary evidence of the benefits of the proposed architecture and multimodal input representation. In addition, we will integrate these experiments and corresponding analyses into the revised manuscript to provide a more comprehensive comparison with existing approaches and clarify the methodological contributions of SpliceMamba.
We sincerely thank the reviewer again for the constructive comments and valuable suggestions, which have helped us substantially improve the completeness of our work. We hope that the additional experiments, revised analyses, and clarifications adequately address the concerns raised and demonstrate the contributions of SpliceMamba. In light of these substantial revisions, we would be grateful if the reviewer could reconsider the overall assessment and score. We would also be pleased to provide any further clarification or conduct additional analyses should any questions or concerns remain. Thank you again for your time and careful consideration.
Hi reviewer xeqM,
Thank you for your reviewing service. The authors have provided fairly extensive rebuttals. Please confirm that you have read them, state which of your concerns are or are not addressed, and whether that changes your recommendations.
Response to Reviewer xeqM – Part1
Response to Weakness & Question 1:
We thank the reviewer for requesting clarification regarding the overlap between ASCOT 56-tissue and GTEx 6-tissue datasets. To solve these concerns, we firstly summarized the overlaps at the donor, event, and gene levels in the Table below.
Subsequently, all shared PSI observations were removed from the ASCOT dataset to create a clean and independent 50-tissue ASCOT dataset, while the GTEx 6-tissue dataset remained unchanged. In this way, both the 50-tissue ASCOT and 6-tissue GTEx datasets are independent for further data partitioning and model training.
Response to Weakness & Question 2:
We thank the reviewer for identifying this important issue regarding the data partitioning and the protocol of model training, selection, and validation. To address these concerns, we have revised the experimental protocol to strictly separate model training, checkpoint selection, and final evaluation on the independent dataset.
Firstly, both the 50-tissue ASCOT and 6-tissue GTEx datasets are partitioned into training, testing, and validation sets at a 7:1:2 ratio using the random seed of 42. Specifically, we now explicitly define three independent data partitions, which are applied consistently to all baseline models and SpliceMamba: Train set: Used exclusively for model training; Test set: Used for hyperparameter tuning and checkpoint selection. The optimal checkpoint is selected based on the Pearson correlation. Validation set: Used exclusively for final performance evaluation.
The detailed dataset partitioning statistics are summarized in the Table below:
Subsequently, we have rerun the model comparisons under this corrected protocol and updated the corresponding performance results in the table below (performance is predicted from the 50-tissue ASCOT validation set with the random seed of 42). Specifically, the publicly pretrained models are loaded for Pangolin and SpliceTransformer, while SpliceAI is not a tissue-specific prediction model and is trained from scratch. w/o Cons: model using sequence and tissue information, without conservation score. w Cons: model using sequence, tissue, and conservation score information.