- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper attempts to incorporate an LLM to amplify the structured attributes with context-aware semantic terms in discrete choice modelling. The author proposes a teacher-informed posterior to balance the weight between conventional observed utility and additional information brought by the LLM. They applied on four travel mode choice dataset and claimed their method has the best fitness performance on test dataset.
Critical strengths
A promising idea is to consider both the score and its uncertainty of the LLM when modelling the weight of the LLM's contribution.
Critical weaknesses
-
The introduction is hard to follow, with inaccurate statements and disrupted writing flow. For example, the key concept "teaching model" is never introduced; Figure 1's title and descriptions are inconsistent. Meanwhile, the figure introduces many concepts and terms without prior definition at that point. In the related work, I can't find a discussion of how the proposed TG-BC differs from the literature.
-
Given the unclear statements in the research gaps, I feel the contribution here is overstated and less persuasive.
-
Misuse of terminology. I am concerned that the authors’ use of "context-dependent" and "context effects" differs from their established meanings in the discrete choice modelling literature [10.1016/j.jmp.2023.102790]. Here, these terms seem to refer to contextual information omitted from the specified attributes, rather than to effects arising from the composition of the choice set. "context-aware" is more appropriate.
-
The methodology part is problematic in its framing. The teacher-informed posterior seems unable to identify . The log-likelihood is decreasing as increases. If the sample size is large, shrinks to 0. That means no contribution is made by the LLM teacher model based on its definition. Unclear how the LLM generates semantic signals . What are the dimensions of and ?
-
Results are overstated.
- Only fitness metrics are compared without considering the complexity of the model.
- The counterfactual experiment setting is unclear.
- No LLM specification or its prompt on semantic terms is reported.
Questions for authors
- Would the authors please clearly identify the research gap with literature evidence that motivates this study?
- Would you report the parameter recovery results of your proposed teacher-informed posterior when has non-zero values? Also, please report the estimated value on four empirical datasets.
- How to distinguish the interpretation of and ?
Unrelated to my final judgement but worth noting here, i) the title here is different from that in the manuscript; ii) the manuscript isn't following the ICLR template; and iii) the in-line citations aren't aligned with academic paper format.