- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper presents CausalRank, a target-specific framework for jointly identifying direct causal parents and ranking their causal effect strengths, motivated by cross-sectional stock return analysis. It combines candidate–target representations with conditional information from other variables, using synthetic pretraining and financial semi-synthetic fine-tuning. Validation spans synthetic and semi-synthetic benchmarks, correlated-proxy tests, ablations, and a U.S. equity application. The results support the framework’s potential, although the justification of specific design choices, model selection procedures, and interpretation of some baseline comparisons require further clarification.
Critical strengths
-
The paper combines direct parent identification and ranking by direct causal effect strength into a target-specific causal ranking task. The problem is well motivated and worth studying, particularly for identifying return drivers from a large pool of candidate stock characteristics.
-
CausalRank integrates representation encoding, target-aware parent interaction, and causal ranking into a unified framework. Its components correspond to the stated motivations for parent identification, conditional evidence extraction, and effect ranking.
-
The paper is clearly structured. The task definition, main method, and principal experimental results are easy to follow.
-
Comparisons involving effect and ranking supervision, candidate competition, and semi-synthetic fine-tuning provide solid evidence for several key designs.
Critical weaknesses
1.Target parents and their effect ranking provide less structural context than a full causal graph, making it harder to inspect relationships among variables against domain knowledge.
2.The rationale and comparisons for specific design choices are insufficient. The paper explains some design motivations and provides relevant ablations supporting several components. However, it does not sufficiently justify why these particular choices are optimal. Specifically, the paper neither demonstrates that the four fixed transformations are the best among alternatives, nor clarifies how the combination of statistics and the network architecture were selected.
Questions for authors
1.The paper does not appear to clearly state whether CausalRank uses independent validation data or tasks during pretraining and fine-tuning, or how its parameters are selected. Could the authors clarify whether independent validation data are used and whether the test set enters parameter tuning?
2.DirectLiNGAM and NOTEARS learn causal structures from which the target’s parents can be extracted. Why do these methods, which directly address parent identification through structure learning, nevertheless underperform methods such as Lasso and LightGBM on Full-FCM?
- In Semi target-generating mechanism, each direct parent enters the target equation through a cubic nonlinear basis function with its first-order linear projection removed, reducing the usefulness of simple linear correlation. Does this disadvantage linear baselines and thereby make the comparison unfair to them?
4 comments
Q1: "Data Splits and Parameter Selection"
A:
We thank the reviewer for pointing out this omission. We apologize for not adequately describing the data splits and model selection procedures. We clarify these details below.
Both pretraining and fine-tuning use independent training, validation, and test sets. The validation sets are used only for checkpoint selection, while the test sets in both Full and Semi experiments remain strictly held out and are never used for training, hyperparameter tuning, or model selection.
The model architecture and training hyperparameters were empirically determined before the experiments, based on panel dimensions, model capacity, and training stability. The main settings include a representation dimension of 64, 8 attention heads, and a feedforward dimension of 128. The learning rates for pretraining and fine-tuning were set to and , respectively, and gradually decreased during training. All these hyperparameters were predetermined and were not adjusted based on test results.
We will provide the complete data splits and model parameters in the revised manuscript.
Q2: "Performance of Causal Discovery Baselines"
A:
We thank the reviewer for raising this question. DirectLiNGAM and NOTEARS are representative methods for causal structure learning. We believe their relatively weak performance on Full-FCM mainly reflects differences between their modeling assumptions and the data-generating mechanisms. DirectLiNGAM assumes linear non-Gaussian structural equations with independent noise, while the original NOTEARS learns causal graphs using linear structural equations. Full-FCM includes nonlinear main effects, multiplicative interactions, and heteroscedastic mechanisms, which go beyond some of the assumptions of these standard models. When the structural equation assumptions do not fully match the underlying generating mechanisms, causal structure recovery may be affected, leading to lower accuracy in identifying the target's direct parents. In contrast, although Lasso also uses a linear model, it can directly exploit predictive signals for feature selection.
Moreover, the optimization objectives of these methods differ from ours. DirectLiNGAM and NOTEARS primarily focus on recovering complete causal graphs, whereas our task additionally requires identifying the direct parents of a specified target and ranking them by their intervention-defined causal effect strengths. We use the absolute weights of incoming edges to the target as ranking scores for both methods, but these weights may not accurately reflect the intervention-defined effect strengths under nonlinear and interaction mechanisms.
Therefore, although DirectLiNGAM and NOTEARS are well-established causal discovery methods, their relatively weak performance on Full-FCM may mainly stem from the mismatch between their standard modeling assumptions and the diverse causal generating mechanisms considered in our study.
Q3: "Fairness to Linear Baselines"
A:
The Semi dataset is designed to evaluate CausalRank's ability to identify nonlinear direct causal relationships and rank their effect strengths under real financial covariate distributions. The purpose of removing the first-order linear projection is to evaluate whether models can identify causal relationships beyond first-order linear information, rather than to disadvantage any particular baseline. Full-FCM and Semi serve different but complementary evaluation purposes. Full-FCM covers diverse causal generating mechanisms, including settings where first-order linear signals remain informative. Semi preserves the distributional properties and correlation structure of real financial covariates while evaluating performance under a nonlinear target-generating mechanism. The baselines is evaluated on both datasets, with identical input data and evaluation protocols for all methods within each dataset. Together, these experiments provide a broader assessment across different causal mechanisms and data distributions, rather than relying on a single experimental setting.
We will clarify the design objectives and complementary roles of these two datasets in the revised manuscript.
We appreciate the reviewer's time and thoughtful feedback. We hope our responses address your concerns and strengthen your positive assessment of our work. We would be happy to answer any further questions.
Thank you for the rebuttal. The authors’ responses have resolved my questions. However, I still see some minor limitations in the method’s design, as noted in my review. My overall assessment therefore remains unchanged.
Thank you for your follow-up and consideration. We fully acknowledge that some minor limitations remain in the current design, and we will continue to address them in our future work. We sincerely appreciate your positive assessment and valuable suggestion. Thank you again for your time and careful consideration.
We thank Reviewer
cvLzfor the comments and constructive feedback. Below we address your questions in detail.A:
We agree that a complete causal graph provides richer structural information about the relationships among variables. CausalRank primarily focuses on identifying the causal effects of financial characteristics on future stock returns. For this objective, identifying the direct parents of the target return provides the necessary causal information without the additional computational cost of recovering the complete causal structure among all financial characteristics.
Moreover, the target-conditioned architecture of CausalRank can, in principle, be extended to other target variables. By treating a characteristic of interest as Y, we can further explore the local causal relationships of other variables. However, such an extension would require additional pretraining and fine-tuning, which would introduce extra computational costs.
We will clarify the differences and connections between our approach and complete causal graph recovery in the revised manuscript.
A:
We thank the reviewer for the suggestions regarding our model design. We further explain the rationale behind the statistical features and network architecture, and provide additional ablation experiments to validate their effectiveness.
Prior work has shown that nonlinear variable transformations and basis function expansions can capture statistical information that conventional linear correlations may miss [1]. Research on financial return prediction also highlights the importance of modeling nonlinear relationships between financial characteristics and returns [2]. Motivated by these findings, we select four simple transformations with different functional properties to preserve linear relationships, capture saturating nonlinearities, emphasize changes in variable magnitude, and represent non-monotonic responses, respectively. These transformations construct statistical features through simple element-wise operations and correlation calculations, providing complementary forms of marginal dependence information at low computational cost in high-dimensional financial panels without additional learnable parameters. Our experiments empirically support their effectiveness, although we cannot exhaustively establish their optimality among all possible alternatives.
We selected our combination of statistics based on the requirements. Regarding statistical information, Target-Factor Statistics provides explicit marginal relationships between X and Y, while Conditional Incremental Evidence supplements these with conditional relationship information obtained from joint Ridge regression coefficients and partial correlations after controlling for other candidates.
Regarding the network architecture, the Panel Representation Encoder extracts cross-sectional and temporal information from financial panels. Target-Aware Parent Interaction combines target relationships with competition among candidate variables to distinguish direct parents from correlated non-parents. The Causal Ranking Decoder then learns direct-parent existence and intervention-defined causal effect strengths.
To further evaluate the effectiveness of combining these statistical features, we conducted four ablation experiments on Full-FCM. All other training settings, random seeds, and evaluation protocols are identical to those of the full model.
The new ablation results show that removing either type of statistical information leads to a performance decline, while the full model achieves the best results. Furthermore, the existing ablation experiments in our paper provide additional support for key design choices in the network modules and training objectives. Removing Candidate Competition reduces AUPRC to 0.7948, while introducing causal-effect and ranking supervision improves NDCG@20 from 0.9021 to 0.9647 and Parent Spearman from 0.6334 to 0.8093. Together, these results support the rationale behind our model design.
We will include the above design rationale and experimental results in the revised manuscript.