- Rating
- 1
- Confidence
- 1
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
I believe it is impossible to provide a review for this paper, as it is full of vague and fuzzy terms that are likely LLM generated (without human-revision).
To prove it, I start with the abstract, that should be the most understandable part of the paper, which motivate and describe at a high level the scope of the paper.
It reads:
" Logic-S shares one circuit across treatment arms. Hard literal selection controls circuit complexity, while the refinement adds expressive capacity through a few permitted nonlinear terms. We introduce a contrast-aware pruning certificate that identifies shared outcome structure whose deletion preserves the fitted treatment effect throughout a declared input domain. The guarantee accounts for nonlinear clamps, outcome scaling, crossfit aggregation, and accepted symbolic corrections. "
I believe that Logic-S is the name of the method even though it was not introduced. Second, what should a constrast-aware certificate be? What is non-linear clamps? I am not familiar with IHDP, ACIC, and they are not explained. The abstract is completely impossible to decipher, as it is full of buzz words and sentences that are disconnected. How is the results "We evaluate..." connected with the historical stroke-trial case?
Reading the paper, however, does not improve the situation: the desiderata are very fuzzy and difficult to understand, same with all the main text. Moving forward, again, Logic-S line 71, is not introduced, I guess is the method of the authors. And this treatment conditional circuit are not yet described or introduced. While line 75: "On our benchmark configurations, the deployed Logic-S ensemble uses fewer than 3% of DragonNet’s fitted parameters while remaining competitive in predictive error" This sentence is completely out of the blue. What benchmarks? What is DragonNet?
The only summary I can provide is that I think the paper has to do with conditional average treatment-effect and Neuro-Symbolic AI using DNF leveraging on Neural Reasoning Networks. I did not get the full picture, even after reading the paper multiple times.
Critical strengths
As it stands, the paper is extremely difficult to follow. There may be valuable insights underneath it, but the writing makes them very difficult to identify
Critical weaknesses
The main weaknesses is clarity. See the summary above.
Questions for authors
See the summary above.
I do not know much about the field, but I am happy to receive an overview of the paper so as to try to give a feedback.
5 comments
I thank the authors for their detailed response and for committing to improve the clarity of the manuscript. After re-reading the paper together with the rebuttal (including the replies to the other reviewers), I have a clearer picture and can give a better feedback. I am not an expert in causal effect estimation, but I work on NeSy, so my comments focus mainly on that side.
Please correct me if I am wrong. The goal is to replace black-box CATE estimators with a model whose estimated effect is itself an explicit symbolic expression. You learn a sparse weighted Łukasiewicz DNF over (x, t), take the difference between its evaluations at t=1 and t=0, add a small symbolic correction, and then prune circuit structure that provably shifts both arms equally, so the remaining expression describes the effect alone. If so, I find the idea reasonable and valuable. However, this framing is not clear just by reading the abstract and introduction.
Here are my concerns:
- As in other t-norm fuzzy logics, logically equivalent formulas can yield different truth degrees, and Łukasiewicz conjunction is not idempotent ( does not yield the same truth degree as ). Is this a problem in your circuit construction?
- From what I understood, you are using the logical circuit more as a function (a sparse piecewise-linear model) than as a set of formulas. Is this correct? If so, what is the advantage for a practitioner compared to directly using a sparse regression model or the symbolic regression alone? Both should be "interpretable".
- Did you consider tractable/probabilistic circuits (Darwiche & Marquis, 2002, A knowledge compilation map), which avoid the fuzzy logic limitations?
- Equation 4 averages the contrasts of three circuits that may encode different rules. What is the interpretation for a practitioner?
- From what I understood, the certificate guarantees fidelity, while the correctness of the causal effect depends on things outside the circuit (identification assumptions and estimation error). Is that right? If not, what is the connection, and can it be measured? How is fidelity liked to faithfulness in formal terms (Marques-Silva, 2023, Logic-Based Explainability in Machine Learning)?
I feel like the main barrier remains clarity. I am genuinely curious about the contribution and happy to continue the discussion.
Thank you for your further questions, and apologies for any delays.
-
Our simplification rules preserve the numerical function under weighted Łukasiewicz semantics. For example, the implementation retains repeated arguments in Łukasiewicz sums and products, while allowing idempotence for lattice minimum and maximum. “DNF” describes the conjunction–disjunction architecture, and should be qualified accordingly in the manuscript.
-
Yes. We fit a piecewise-linear outcome function whose operations have an explicit logical interpretation. Its numerical predictions depend on the selected literals, weights, and clamps.
The motivation is to combine learned nonlinear interactions with an exportable expression that can be inspected and simplified. Compared with sparse linear regression on the original covariates, the circuit can learn interactions and saturation effects. Sparse regression with an appropriate nonlinear feature basis can also represent richer effects, and symbolic regression is a particularly relevant comparator. It is our aim, that much of the outcome functions can be represented relatively cheaply here with piecewise linear approximation, allowing for a less expensive search over a non-linear basis in the residual.
Our follow-up response reviewer 1 makes the empirical tradeoff a bit clearer. Restricted symbolic regression performs well, including outperforming the hybrid method on IHDP. On the ACIC sensitivity analysis reported above, the cross-fitted hybrid has lower mean and median PEHE, while standalone symbolic regression has lower ATE error. These findings support some limited evidence of setting specific tradeoffs.
-
Probabilistic circuits seems like an important comparator. We admit to being a bit blind in this area. Wang and Kwiatkowska (2023) extend this direction to causal inference queries and provide a particularly relevant comparison for future work. Taking into consideration your concern about idempotence, the general difficulty of interpreting 'truth degree', and some struggles we have had with dead gradients in saturated regions, we should take PC based alternatives more seriously.
-
Equation 4 represents an arithmetic average of three fitted treatment-effect functions, each expressed in original outcome units. For a practitioner, the deployed estimate combines the three fold-specific estimates with equal weight. Each fold may use different clauses, and their contributions may reinforce or cancel.
This introduces an interpretability tradeoff that deserves clearer discussion. An explanation of the deployed predictor must include all three expressions and their averaging operation. A clause from an individual fold provides only a partial account, and differing fold expressions can reveal sensitivity to the training split.
Our simplification preserves each fitted contrast and therefore preserves their average. We can present the resulting aggregate as an explicit arithmetic expression. The compression measurements characterize its size, but interpretability of it (while intuitively will be more difficult) needs to be explored more deeply.
- Your characterization is correct. The certificate guarantees that the simplified expression reproduces the complete fitted treatment contrast for every input within the declared domain. Causal interpretation requires identification assumptions, while estimation error determines how accurately the fitted contrast approximates the causal target. Our motivation is to make the fitted dependencies available for inspection. A practitioner could examine which characteristics enter the estimated effect, how they interact, and whether those patterns conflict with domain knowledge. Such inspection may expose problems and motivate further investigation. Whether practitioners can do this reliably with our representations remains an empirical question.
More precisely, if is the original fitted contrast and is its certified simplification, we establish
This provides exact functional fidelity within . Consequently, simplification preserves the model’s treatment-effect estimation errors on that domain.
Regarding Marques-Silva’s formal-explanation framework, this equivalence also preserves explanation queries defined over the same domain and prediction criterion. For example, feature conditions sufficient to guarantee that the estimated effect exceeds a specified threshold hold for both representations. Extracting subset-minimal sufficient conditions would require an additional explanation procedure. We should distinguish that task from the functional equivalence established by our certificate.
Thank you very much for engaging with us. Our next re-write will be much stronger for it.
We thank you for the time and effort it took to work through the manuscript, and identifying areas where the presentation was particularly taxing to follow.
We agree that the abstract and introduction introduce too many technical terms before explaining the model and its purpose.
Your interpretation is largely correct. We introduce a neuro-symbolic estimator of conditional average treatment effects (CATE), heavily inspired by Neural Reasoning Networks (NRN). “Logic-S” names the S-learner variant, which uses one shared outcome model taking both observed characteristics and treatment assignment as inputs. This distinction becomes important when applying the underlying model to other meta-learning frameworks described in foundational causal machine learning literature.
Our aim is to estimate how the predicted effect of treatment varies within observed characteristics, and then simplify the fitted expression for that effect to improve interpretation of the fitted model by practitioners.
The underlying model uses a neural network whose units compute weighted logical conjunctions and disjunctions. We evaluate that network with treatment set to 1 and to 0, then subtract the predictions to obtain the estimated treatment effect. An optional symbolic correction adds a small fitted expression to improve outcome prediction. The symbolic correction is a simplified, or restricted, form of symbolic regression. The base model has interpretable semantics under weighted Łukasiewicz logic, and the additional symbolic correction is only allowed a small budget of terms and expressions to remain human readable. A logic representation is desirable for both interpretability, and for simplification. The restricted symbolic correction allows for more expressivity of heterogeneity in a compact and human-readable form.
We characterize a domain-specific simplification procedure intended to make the fitted treatment contrast easier to inspect, including which observed characteristics it depends on and how they enter the expression. Whether this improves practitioners’ understanding remains a question for a human evaluation study.
The simplification procedure asks whether parts of the network can be removed while preserving that predicted treatment difference for every input within specified bounds. The “certificate” is a sufficient mathematical condition for permitting such a deletion. “Clamps” are the operations that restrict intermediate values to the interval [0,1] (valid truth values). These definitions should have appeared before we used the terms.
We also agree that the benchmark acronyms, the DragonNet comparison, and the purpose of the stroke-trial application require clearer introductions. The presentation should explain what each evaluation contributes before presenting its results.
We take responsibility for the submitted manuscript. We accept the criticism that the writing needs substantial improvement. We would appreciate clarification of the specific conduct referred to as “unprofessional behavior,” so that we can address that concern directly. We have been transparent with our AI usage, and have included both data and code to replicate our results.
Thank you again for your time, and apologies for any frustration.