- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper proposes TLSI, a dual-path architecture that combines direct neural classification with predictions from a learned latent structure. It constructs token-ID-group prototypes, performs compatibility-based message passing, and fuses the two branches through a margin-dependent gate. Experiments primarily compare randomly initialized architectures on six inference datasets, with an additional neural-only control on FOLIO.
Critical strengths
- The paper addresses a question: whether learned latent structure can provide predictions complementary to direct neural classification.
- The ten-seed, same-encoder neural-only control provides evidence for the benefit of adding the structural branch.
- The authors explicitly acknowledge important limitations, including the restricted evaluation setting and the single-seed component analyses.
Critical weaknesses
- The specific contribution of the proposed structural mechanism is insufficiently established. The neural-only control demonstrates a benefit from adding the entire branch, but this simultaneously introduces additional capacity, computation, supervision, and prediction fusion. Without comparisons against a similarly sized second neural branch or simplified/randomized graph structures, the results do not establish an advantage over simpler alternatives.
- The baseline coverage limits the significance of the results. The main comparisons focus on randomly initialized decoder-style architectures, without strong bidirectional encoders or directly relevant structured-classification baselines. These comparisons provide limited evidence that TLSI advances existing approaches to language inference. The pretrained LLM-plus-solver reference results use a different experimental setting and do not resolve this gap.
- The architectural complexity is not sufficiently justified by the demonstrated benefits. The method combines extensive encoding machinery with several structural and fusion components. Component ablations use a single seed, while the independently trained, ten-seed neural-only comparison is restricted to FOLIO and yields a 1.58-point improvement. The absence of systematic training and inference cost comparisons further limits assessment of the practical value of this complexity.
Questions for authors
-
Do the neural-only control results generalize beyond FOLIO?
-
How does TLSI compare with strong bidirectional encoders and simpler structured-classification baselines under comparable training budgets?