- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
MoLRIFT adapts the pairwise differential regression approach from PADRE for use with a frozen TabPFN-3 + CheMeleon pipeline. It employs a second, frozen TFM to predict the out-of-sample error differential of the global model, applying corrections via a combination of bidirectional averaging and similarity-gated aggregation. However, the global TFM baseline is already quite strong; while the pairwise correction achieves more wins than losses across tasks, the improvement in raw RMSE is marginal, and the confidence interval for the comparison against a simple kNN-residual transfer method includes zero.
Critical strengths
- Provides complete procedures and hyperparameters for OOF cross-fitting, anchor selection, bidirectional inference and gating, enabling replication or ablation. This is valuable for exploring relative prediction within the tabular ICL framework.
- Relative to tree models/GNNs requiring per-task hyperparameter search MoLRIFT's frozen pipeline achieves higher Elo with less end-to-end wall-clock time, placing it on the observed Pareto frontier.
Critical weaknesses
- Against kNN residual transfer (using stored OOF errors from similar labeled molecules without learning pairwise differences), MoLRIFT's RMSE reduction is 0.00402 with 95% CI including zero ([−0.00110, 0.00930], Table 3). Against single-molecule residual, the improvement is 0.00768—statistically distinguishable from zero but numerically tiny. The incremental advantage of pairwise correction over "directly reusing neighbor residuals" is not established.
- Causilo (Cho et al., 2026) achieves a higher Elo score on TabArena with an inference time approximately 40% that of TabPFN-3.5; however, it is employed solely as a robustness backbone rather than being included in the primary comparisons or serving as a relation predictor. Furthermore, global TFM fine-tuning—conducted under an equivalent computational budget—is entirely absent from the evaluation. If a single round of lightweight fine-tuning could yield greater gains than pairwise correction, then the added engineering complexity would lack justification.
Questions for authors
- The relation TFM's supervision signal depends on OOF residuals systematically underestimates errors on structurally distant molecules—as indicated by CheMeleon's failure on activity cliffs and stereochemistry—is the relation TFM merely fitting an already optimistic noise pattern? Are there diagnostic experiments that can distinguish learning a transferable correction relation from fitting spurious correlations in OOF residuals?
- Under a matched computational budget, what is MoLRIFT's incremental advantage over directly fine-tuning the global TFM for a few steps? If fine-tuning yields larger gains, is the engineering complexity of OOF construction + relation context + bidirectional inference + gating justified?
3 comments
The author's answer addresses my concerns, and I will increase the score to 3, but as I am not familiar with the relevant field, I will keep the confidence score unchanged.
Thank you for reviewing the additional results and reconsidering the paper. We’re glad the OOF diagnostics and fine-tuning comparison helped address your concerns.
We thank the reviewer for the feedback. We clarify the evidence for learning useful corrections from OOF errors and the value of our approach relative to residual transfer and global fine-tuning.
W1. Magnitude and consistency of the gains over residual baselines.
MolRIFT’s learned pairwise correction improves on both kNN residual transfer and the single-molecule residual predictor across most tasks, although the mean RMSE gains are modest. Moreover, mean RMSE alone does not show how broadly these gains occur, because larger losses on a few tasks can offset smaller gains across many others.
In structural generalization, more accurate predictions can help prioritize unfamiliar compounds for experimental testing. We therefore believe that improving predictions consistently across diverse tasks is as important as the absolute magnitude of improvement. MolRIFT shows this consistency against both residual baselines, achieving lower RMSE and MAE on most of the 47 regression tasks in each comparison.
We have added the full per-task RMSE and MAE comparisons against both residual baselines in Appendix C.2, Tables 13–16 (pp. 26–29 of the revised manuscript), so that readers can assess the magnitude of these differences alongside their consistency across tasks.
Q1. OOF errors and transfer to difficult molecules.
Although OOF errors are smaller than structural-test errors, MolRIFT’s corrections track unseen errors better than matched kNN and shuffled-label controls. We first confirmed the difference in error magnitude on MoleculeACE.
We then tested whether relationships learned from these smaller OOF errors remain useful on the held-out molecules in our primary structural splits. Across 47 regression tasks, we measured the Spearman correlation between each method’s predicted correction and the adjustment actually needed by the global prediction, yq−μq.
MolRIFT’s higher correlation with actual test errors provides evidence that the learned pair relationships provide useful information about unseen molecules beyond directly reusing neighbor residuals. The comparison with shuffled labels further supports the role of the true pair labels in capturing these transferable relationships.
W2/Q2. Backbone choice and comparison with global fine-tuning.
Causilo was released in mid-September, leaving insufficient time to repeat the full experimental suite with it before submission. We nevertheless included it in our backbone experiments, where Causilo serves as both the global and relation TFM.
Because MolRIFT constructs molecular-relation contexts while keeping the TFM parameters unchanged, the same framework can be applied to different TFM backbones. Our Causilo results illustrate how advances in foundation models can translate into better molecular predictions, and newer models such as Kumo Tabular could provide further gains within the same framework.
MolRIFT achieves lower error than the tested lightweight fine-tuning of the global TFM at comparable measured runtimes. In this additional evaluation, both methods use the same TabPFN-3 checkpoints, molecular features, and outer splits across all 58 tasks. Fine-tuning uses AdamW with a learning rate of 10−5 for up to eight epochs. For each split, we use the measured MolRIFT runtime as the budget for fine-tuning and prediction, reserving time for prediction. The table reports the MolRIFT reference from this matched evaluation, with runtime measured from precomputed features through prediction.
These results support the additional computation used by MolRIFT’s molecular-relation contexts over the tested lightweight fine-tuning alternative.