- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes PATHCAST, a pathway-structured Transformer designed to forecast future group-level gene expression in cardiac organoids from sparse, irregularly sampled bulk RNA-seq histories. The model takes historical expression profiles alongside external priors (specifically gene text descriptions from NCBI, UniProt, and GO encoded via SapBERT, and pathway membership masks from Hallmark and Reactome) and feeds them into a dual-branch architecture consisting of a history branch using differential Transformers and a state branch projecting pathway states. The fused representations predict continuous-time state increments, which are decoded into additive pathway, auxiliary, and gene-level contributions. Experiments on three cardiac organoid datasets and one hepatic differentiation dataset show lower MSE compared to several general time-series and trajectory baselines.
Critical strengths
-
The targeted problem of forecasting future transcriptomic profiles from short sampled histories is practical for experimental planning in organoid development. Decomposing the predicted expression changes into additive pathway, auxiliary, and gene-level terms provides a way to inspect which biological modules drive the model's outputs.
-
The empirical evaluation covers multiple scenarios, including within-condition forecasting, reference-assisted prediction, and cross-study transfer. Incorporating an uncertainty head for risk ranking is also a useful addition for identifying reliable gene predictions in downstream analysis.
Critical weaknesses
-
The core methodological novelty and motivation are unclear, and the baseline comparisons appear unfair. Rather than offering a fundamental algorithmic advance, the architecture reads like an over-engineered assembly of existing modules. Moreover, PATHCAST relies heavily on external biological priors and engineered historical summary features that standard time-series baselines do not have access to.
-
The presentation and visual design of the figures need substantial improvement. Figure 1 and especially Figure 2 are overly crowded and very difficult to read. The excessive use of different colors, nested boxes, and dense mathematical notations in Figure 2 is visually overwhelming and easily causes misunderstanding about how tensors actually flow between the shared inputs, the history branch, and the state branch. In addition, while the whole paper emphasizes pathway-structured interpretability, the cross-study transfer experiment abruptly switches to pretraining a "direct-gene variant" rather than the main pathway-structured model, which undermines the consistency of the core story.
Questions for authors
-
Since PATHCAST takes rich external priors and hand-crafted historical statistics, how do the authors ensure a fair comparison with general time-series baselines? If baselines like iTransformer are also provided with the same hand-crafted slope/mean features and text embeddings, does PATHCAST still hold a meaningful advantage?
-
In Table 5, removing the state branch, sustained trend, gene correction, or text modules results in very tiny MSE differences. How do the authors justify the heavy architectural and hyperparameter complexity given such marginal gains? Furthermore, why was the "direct-gene variant" used for cross-study transfer instead of the proposed pathway-structured model?
2 comments
Thank you for the rebuttal, which addresses some of my concerns. However, my main concerns about methodological novelty and the adequacy of the baseline comparisons remain. Considering other reviewers’ comments, I am inclined to maintain my original score.
We appreciate the time you took to review our manuscript and provide detailed feedback. Our point-by-point responses follow.
W1 / Q1: Methodological contribution and fairness of baseline comparisons
Motivation and contribution. PATHCAST addresses forecasting from sparse, irregularly sampled RNA histories with many correlated genes and few observed time points. Its methodological contribution is a pathway-structured increment model: observed expression is jointly projected into reconstructable pathway states, history and recent state changes condition continuous-time forecasts, and membership-constrained decoding maps state increments into explicit pathway contributions to gene-expression changes. Auxiliary and gene-level terms accommodate variation outside the pathway representation. This connects the representation, temporal prediction, and interpretation within the forecast computation.
The ablation evidence supporting these design choices is discussed in W2/Q2 below.
Fairness of information access. Historical means and slopes are computed from the same observed expression available to the baselines; their explicit encoding can nevertheless affect performance. Pathway annotations and gene descriptions provide additional biological information. To test the effect of historical statistics and text access, we supplied iTransformer with the same gene-level historical statistics and fixed gene-text embeddings, projected into its gene representations. A separate matched raw-input control uses the same RNA input adapter and training configuration as the augmented variant.
The feature-augmented iTransformer and PATHCAST rows below report mean ± standard deviation across three runs on EB-hCO.
PATHCAST outperforms the feature-augmented iTransformer configuration. Providing historical statistics and text therefore does not automatically improve forecasting.
W2 / Q2: Architectural complexity, figure clarity, and the direct-gene transfer variant
Architectural complexity. Table 5 shows that the components contribute at different scales and across different metrics. Removing history conditioning increases MSE from 0.0322 to 0.0924, while removing auxiliary forecast outputs increases it to 0.0472. Other components have benefits that are more apparent beyond overall MSE: removing the sustained trend and gene-level correction increases Top50 MSE by 19.4% and 18.4%, respectively. Overall MSE alone therefore gives an incomplete picture of these components’ contributions. We will clarify their respective roles and the associated hyperparameter settings.
Figure clarity. We will simplify Figures 1 and 2, explicitly labeling the shared inputs and the connections between the history branch, state branch, and output reconstruction.
Cross-study transfer. Table 3 tests whether cross-study pretraining improves forecasting when the target study provides limited observations. The direct-gene variant provides a common gene-level representation for this experiment, separating the transfer question from the pathway-specific representation. It retains PATHCAST’s temporal modeling and observation-anchored forecasting. All four strategies use the same architecture, gene panel, observation window, and forecast dates, so their comparison isolates the effects of pretraining and adaptation within this variant. Table 3 thus complements the pathway-based evaluations with a controlled study of transfer. We will make the variant and the scope of this conclusion explicit in the Table 3 caption.