- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies semantic naming of unnamed observed and latent variables from numerical measurements and a small set of known names. CAUSALBRIDGE combines causal discovery, structure-constrained embedding optimization, and prefix-based language-model adaptation. Experiments on questionnaires and robotic/vehicle data show improvements in name retrieval.
Critical strengths
-
Jointly constraining unknown semantic embeddings using relational information and named anchors is an appealing alternative to independent naming.
-
The paper considers multiple domains, masking levels, graph sources, and language-model backbones.
Critical weaknesses
-
The practical motivation for naming observed variables is not fully convincing. In many scientific applications, the names of observed variables are already determined, and the primary goal is to discover their causal relationships. Moreover, variable names may simply be identifiers, such as gene A, gene B, and gene C, rather than meaningful semantic descriptions. The authors should clarify when recovering a name constitutes a substantive scientific contribution and distinguish naming a variable from understanding its function or causal role.
-
Statistical dependence is represented through cosine similarity between semantic embeddings. I'm not sure whether this implementation makes sense: causally related variables need not have similar meanings.
-
In Table 29, removing the prefix improves latent-variable naming quality at all four masking levels under discovered graphs. These results require reconciliation with the claimed central role of the prefix.
As a researcher in causal inference, I find that this paper does not contribute new knowledge to the causal inference community (which is, of course, not necessarily a weakness). Instead, it applies existing causal inference methods to extract information from data to determine the semantics of variables. I find this task somewhat unusual, and I am not convinced that it presents substantial challenges or has significant practical or theoretical value. However, I do not hold this view strongly, and I would like to consider the opinions of other reviewers and the authors' rebuttal before deciding whether to revise my assessment.
Questions for authors
I find semantic interpretation of latent variables to be the most compelling application of this framework. I therefore encourage the authors to engage more deeply with related work on causal discovery among latent variables [1-8].
[1] Learning linear bayesian networks with latent variables. ICML 2013.
[2] Triad constraints for learning causal structure of latent variables. NeurIPS 2019.
[3] Latent hierarchical causal structure discovery with rank constraints. NeurIPS 2022.
[4] Structural estimation of partially observed linear non-gaussian acyclic model: A practical approach with identifiability. ICLR 2024.
[5] Score-based causal discovery of latent variable causal models. ICML 2024.
[6] Learning Discrete Latent Variable Structures with Tensor Rank Conditions. NeurIPS 2024.
[7] Recovery of causal graph involving latent variables via homologous surrogates. ICLR 2025.
[8] Efficient and trustworthy causal discovery with latent variables and complex relations. ICLR 2025.
8 comments
We sincerely appreciate your thoughtful review and helpful references (2/3)
W2. Choice of cosine similarity for the link between dependence and names.
Thanks for the question. We state the link between dependence and names as a modeling assumption (Section 2, L187-189), and the method asks only that a cause and its effect share part of their meaning, because the two can mean different things. The embedding of an effect is generated from the embeddings of its causes by a learned operator and keeps a residual of its own (Section 3.2). For strongly dependent pairs, the similarity only has to reach a fraction of their dependence. On a negatively correlated edge, the cause contributes its opposite meaning through a learned negation map.
The true names support this assumption on every data set. We take the pairs of a cause and its effect from the published keys and the supplied graphs, and measure how similar their true names are by the cosine similarity in the space that scores the names (Section 4). We then compare this similarity with the median similarity over all pairs of the same kind, such as all pairs of a latent variable and an item. If causal relations said nothing about names, half of the cause-effect pairs would fall below this median. Over all data sets, about 16% do (Appendix N).
Moreover, the link is stated for a general measure of dependence between embeddings (Section 3.2, L255-257). The conditional mutual information (CMI) is a standard measure of conditional dependence that is defined for any distribution and any form of relation. With the CMI, the embeddings are asked to share as much information as the variables. The cosine similarity corresponds to the CMI under a Gaussian model of the embeddings (Appendix C, L1486-1501), and the main method uses it for its simplicity and scalability. The two versions write essentially the same names, and on the discovered graph their NRR@1 differs by at most .05 at every masking level (Appendix M, L3568-3576). The measure is therefore a choice of the user, who can take the one that fits the scenario best.
W3. The prefix and naming quality in Table 29.
Thank you for this careful observation. The gap in naming quality comes from the form of some names. With the prefix, the name of a discovered latent variable is sometimes written as a sentence in the style of a questionnaire item. For example, the full method gives “I felt I was not good enough.” for the depression scale of DASS, and the variant without the prefix gives the short name “worthlessness”. The judge recognizes the sentence as depression, but the form check of naming quality rejects it, since it is not a name. The table compares the full method with the variant without the prefix on latent variables at 20 / 50 / 75 / 90% masking. All rows except the fourth are under the discovered graph.
| Latent variables | With the prefix | Without the prefix |
|---|---|---|
| Identification | .531/.511/.441/.254 | .549/.474/.443/.229 |
| Recognized, but written as a sentence | .086/.086/.052/.037 | .011/.000/.006/.003 |
| Naming quality | .446/.426/.390/.217 | .537/.474/.437/.226 |
| Naming quality under the supplied graph | .596/.518/.500/.332 | .496/.465/.462/.273 |
| NRR@1 | .540/.486/.386/.240 | .414/.386/.406/.186 |
Naming quality is identification minus the second row. Identification is about the same with and without the prefix, so the gap in naming quality comes from these sentences. The sentences concentrate on discovered latent variables with only one or two items. The model then writes the name in the style of those few items. Under the supplied graph, each latent variable has more items, and the prefix raises naming quality at every masking level (fourth row).
In the paper, the central role of the prefix is measured in NRR@1, which scores how precisely a name places its meaning among all names of the system. Removing the prefix lowers NRR@1 on all variables at almost every masking level (Tables 27 to 29). The last row shows this on the same latent variables, where the full method is clearly ahead while many names remain. We have added this analysis and the examples to the updated manuscript (Appendix Q).
We sincerely appreciate your thoughtful review and helpful references (3/3)
W4. Contribution to causal inference and the value of the task.
Thank you for sharing this view. Our contribution to causal inference is the step that follows discovery. Methods such as [1-8] return variables as nodes with only an identifier such as L1, and their real-data examples name them by hand (Appendix S). A perfectly identified latent variable may be well disentangled from the others, but no semantic meaning is recovered in the procedure. CausalBridge gives it a meaning from its causal relations to the named variables, and Proposition 3 characterizes the assignments that satisfy these relations. The output of discovery thus becomes hypotheses that a person can read and test.
A new experiment shows that these names come from the causal structure. We replaced a third, two thirds or all of the edges of the discovered graph with random edges of the same kind and kept everything else fixed, including the language model, the prompt template and the decoding. We then scored each latent variable against its name under the unchanged graph. The table gives NRR@1 at 20 / 50 / 75 / 90% masking, with the best value at each level in bold.
| Edges replaced | NRR@1 on latent variables |
|---|---|
| None | .540/.486/.386/.240 |
| 1/3 | .374/.322/.275/.203 |
| 2/3 | .223/.234/.209/.149 |
| All (random graph) | .133/.107/.130/.151 |
Accuracy falls as more edges are replaced, so the name comes from the causal relations of the latent variable. Under the supplied graph the conclusion is the same, and we have added these experiments to the updated manuscript (Appendix N).
The task is hard because the meaning must come from the structure. A latent variable has no text of its own, and an unnamed channel has only an identifier, so a language prior alone cannot supply their meaning. Standard interpretability tools ask a language model what the data suggest, and with no structure supplied they stay well below CausalBridge on the vehicle CAN at every masking level (Table 9). Beyond the settings of W1, naming the features of neural networks is a practical use, and CausalBridge writes each name from one prompt, with 2.6 to 56.6 times fewer tokens per latent variable than the sampling methods (Section 4).
Q1. Related work on causal discovery with latent variables [1-8].
Thank you for these recommendations. These works discover the causal structure among latent variables and state when it is identifiable, and the updated manuscript now cites them in the introduction. Appendix S discusses them in detail, including the data type each of them fits and how their latent variables are named when they are applied to real data. They return the latent variables as nodes with only an identifier, such as L1. CausalBridge takes such a graph as input to name them, so whichever of these methods fits the data can supply the graph.
Thanks again for the time and care you invested in reviewing our work. If any part of our responses remains unclear, please feel free to let us know, and we will be glad to clarify further.
We sincerely appreciate your thoughtful review and helpful references (1/3)
Dear Reviewer 6LhZ,
We sincerely appreciate your time and the thoughtful review. We are glad that you found the semantic interpretation of latent variables the most compelling application of our framework. Following your suggestions, we have tested the link between dependence and names, shown that the names of latent variables come from the causal structure, and added a discussion of causal discovery with latent variables [1-8]. All section, table and appendix numbers below refer to the updated manuscript, where every change is marked in blue. Please find our point-by-point responses below.
W1. When does naming an observed variable matter, and how does a name differ from a function or causal role?
Thanks for raising this question. Naming is substantive whenever the meaning of a variable is unknown. We would like to highlight the difference between a semantic meaning and an identifier for observed variables. The semantic meaning here describes what a variable means with richer semantic information, such as “rear left wheel speed”, while an observed identifier such as “gene A” does not provide anything beyond that identifier. Recovering the semantic meaning, like a description, for both observed and latent variables is our task. This need arises when a vehicle CAN bus records channels that its maker does not document, which engineers decode by hand and our vehicle experiments reproduce. It also arises when shared robot corpora such as Open X-Embodiment record observation and action spaces that differ across robots. It arises most clearly for latent variables, which causal discovery returns with only an identifier.
As for the difference between a name and a causal role, the two play different parts in the method. The functional/causal role is the input of the method, namely what a variable causes, what causes it and what it is independent of. The name is the output, a description in words that agrees with that role and with the named variables.