- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper frames the prediction of spatial gene expression from H&E images as a grouped regression problem. The spot-wise Mean Squared Error (MSE) can be precisely decomposed into two equally weighted components, namely the intra-slice residual variance () and the slice-mean residual (). The authors propose SCOR, utilizing as the training objective, where the weight controls the contribution of the slice-mean residual, and demonstrate that this is mathematically equivalent to applying a ridge penalty to the bias term of each slice before eliminating it; they also provide formulations for mini-batch training and intra-slice pairwise representations. Experiments employed frozen UNI2-h features alongside MLP or ridge prediction heads; the hyperparameter was set to based on the ccRCC dataset and subsequently kept fixed. The method was compared against MSE, Direct PCC, MISO, and STRank across eight tasks in the HEST-1K benchmark, as well as on the HER2ST and STNet datasets. Additionally, the underlying mechanism was analyzed through experiments involving intra-slice and cross-slice pairings, pairwise distance binning, and varying the number of training slices.
Critical strengths
-
Motivated by a specific problem, the proposed method is concise and theoretically grounded. The paper points out that spot-wise MSE implicitly assigns equal weight to intra-slice errors and slice-mean errors. SCOR explicitly controls the latter using a weighting parameter; it is equivalent to applying a ridge penalty to slice biases without altering the representation, model architecture, or inference process. This offers a clear characterization of a training objective choice that is often overlooked, and the method is "plug-and-play."
-
The empirical evidence is rigorously controlled and goes beyond merely optimizing for evaluation metrics. All objective functions were compared using identical frozen UNI2-h features, the same prediction head, and consistent data splits and training budgets. The hyperparameter was selected based on the ccRCC dataset alone; transferring this setting to HER2ST and STNet without re-tuning still yielded performance improvements. Diagnostic experiments (examining intra-slice versus cross-slice pairings, pairing distances, and the number of training slices) validated the underlying mechanism. Total MSE decreased in 7 out of 10 tasks, while slice-mean errors remained largely unchanged near the selected value (Table 5); this indicates that the gains did not simply stem from reducing error components to which PCC is inherently insensitive. The experimental work is robust.
Critical weaknesses
The scope of validation is limited and insufficient to support the conclusion that this is a universal design choice that has been overlooked.
The experiments utilized only a single frozen encoder (UNI2-h, reduced to 256 dimensions via PCA) and two types of prediction heads (MLP and ridge regression); HER2ST and STNet served merely as external datasets rather than as additional models for comparison. While leaving representations and model architectures unchanged is a key selling point of the paper, SCOR was not validated on existing MSE-based training methods, such as ST-Net, HisToGene, Hist2ST, or TRIPLEX, nor was it tested in an end-to-end encoder fine-tuning setting. End-to-end training typically necessitates smaller batch sizes, resulting in few spots per slice within a single batch. According to the analysis in Appendix A.1, the effective coefficient for intra-slice terms drops significantly under these conditions; in the limiting case of a single spot per slice, SCOR degenerates into a scaled version of standard MSE.
The scope of comparison is also limited. The prediction targets in HEST-1K were not normalized for library size (Section 3), meaning that variations in sequencing depth across slices could introduce technical mean shifts. However, the paper fails to compare SCOR against the simplest alternative approaches, namely MSE with slice-wise centering or standardization of targets, and PCC loss calculated on a per-slice basis. Given the current validation scope, the average pooled PCC on HEST-1K improved by only 0.0046 (with gains in 5 tasks, no change in 1, and declines in 2), and the performance gap relative to MISO remains marginal.
Consequently, the existing evidence demonstrates only a modest improvement for SCOR under this specific setting; it does not yet establish the method as a universal design choice. Furthermore, the authors have made no commitments or statements regarding code release; while not strictly obligatory, I would strongly prefer that the authors provide code to allow for verification.
Questions for authors
Please compare SCOR with the following under identical settings, namely MSE calculated after slice-wise centering or standardization of targets, and slice-wise PCC loss. Additionally, please clarify whether Direct PCC is calculated across slices within a minibatch.
Please evaluate SCOR on several existing MSE-based training methods, such as ST-Net, HisToGene, Hist2ST, or TRIPLEX, including at least one setup involving end-to-end encoder fine-tuning. End-to-end training typically employs smaller batch sizes; as noted in Appendix A.1, this results in fewer spots per slice within a batch, significantly reducing the effective coefficients for intra-slice terms. Please report the performance gains achieved by SCOR in this setting and indicate whether batch organization by slice is required. Also, please test other FM embeddings using the HEST-1K framework.
If SCOR’s advantages remain evident after the authors provide the aforementioned validations, I will consider raising the score to 3.