W1. Writing is very hard to understand. A lot of terms not well explained, and experiment description have a lot of vagueness.
(1) Please give the exact definition of the neighborhood-gradient features g: gradient of what loss, with respect to which parameters or activations, which "neighborhood" (perturbed inputs? neighboring tokens? embedding-space neighbors?), and which content tokens and layers. Please also report the extra compute relative to a forward-only probe.
(2) Do LR Probe, SAPLMA, "Hidden only" and HNGRE all use the same feature (mean-pooled answer tokens over the same layers)? Why is your Hidden-only MLP about 8 AUROC points below SAPLMA on Llama3-TriviaQA? Please report a cross-entropy MLP tuned with the same budget as the EDL head, with mean ± std over at least 5 seeds and splits. If the 0.001 gap from the gradient branch and the EDL-vs-CE gap do not survive this, the method contribution reduces to "use an EDL loss."
(3) For PopQA, what is the AUROC within each relation type, and with relation-held-out splits? What is the AUROC of a classifier that sees only the relation ID (or only subject popularity)?
(4) How are abstentions ("I don't know", "I'm not sure") and partial or malformed answers labeled? What fraction of HALL are refusals? What is the label noise rate of the string matcher on a manually audited sample?
(5) How is the "factual-support direction" in Section 4.3 obtained (LR weight, mean difference, or EDL gradient)? What defines a "valid" case in Fig. 3(a)? Are the random and orthogonal controls norm-matched, and what is α relative to the activation norm?
(6) [Clarification] Which model, dataset and split does Fig. 11 show? Its near-perfect separation conflicts with the reported test AUROC.
W2. The definition of latent void and hallucination seem to be circular. More specifically, the definition of a latent void has hallucination built into it. That makes the hypothesis close to true by definition.
W3. Novelty relative to closely related prior work is not yet clearly established.
- Probing answer-token hidden states to predict correctness across datasets and models is already shown in Orgad et al. (2025, ICLR, "LLMs Know More Than They Show"), alongside the cited Azaria & Mitchell (2023) and Chen et al. (2024, INSIDE).
- Ferrando et al. (2025, ICLR, "Do I Know This Entity?") find known/unknown-entity directions and steer them to causally change refusal and hallucination, which overlaps closely with Section 4.3; neither paper is cited.
- Semantic entropy (Farquhar et al., 2024, Nature) and GRADE (Wang et al., 2026) are cited but not compared
- Semantic-entropy probes (Kossen et al., 2024, arXiv:2406.15927) and P(IK) (Kadavath et al., 2022, arXiv) would be natural baselines.
W4. It is unclear how much of the gain comes from the proposed components rather than from training choices.
The gradient branch that gives HNGRE its name adds 0.001 AUROC over Hidden+EDL (0.8403 vs. 0.8393, Table 10), on a single seed and split. The authors' own hidden-only MLP scores below SAPLMA (0.8017 vs. about 0.81), which suggests the margin may reflect the EDL loss or tuning rather than the mechanism. The analysis would be strengthened by multi-seed results with matched features. PopQA could also use a relation-held-out split, since the examples in Table 4 suggest relation type alone strongly predicts correctness.