- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies nuisance-induced confounding in distribution-based sensitivity analysis of LLM outputs. The authors argue that raw output distributions may conflate semantic changes with nuisance variation arising from factors such as stochastic generation, surface form, language, and representation choice. They formalize this phenomenon through a latent-variable model in which outputs depend on both semantic meaning and nuisance factors, show that raw-output sensitivity can be non-zero even when meaning is unchanged, and derive a sufficient condition for nuisance-invariant sensitivity analysis. Motivated by this analysis, they propose a semantic-normalization framework based on summarizing outputs prior to computing distributional sensitivity. Experiments on nuisance perturbations, controlled semantic perturbations, and multilingual settings suggest that summary-based normalization reduces sensitivity to nuisance variation while maintaining sensitivity to semantically meaningful changes.
Critical strengths
(1) The paper provides a clear measurement-theoretic formalization of nuisance effects in distribution-based sensitivity analysis. The theoretical development seems coherent and motivates a concrete invariance criterion for representations used in sensitivity estimation. (2) The paper does more than present a theoretical argument; it also proposes a simple normalization procedure and evaluates it across several controlled settings, including multilingual experiments. The empirical results are broadly consistent with the motivating intuition.
Critical weaknesses
(1) I think the paper's strongest contribution is narrower than the paper currently suggests. The theoretical framework and empirical results support the claim that distribution-based sensitivity metrics measure a mixture of semantic and non-semantic variation, and that a normalization step may be useful when the goal is specifically to quantify semantic change. However, I am less convinced that the underlying observation that nuisance variation can affect measured sensitivity is itself novel. Recent work already studies distribution-based auditing [1,2], semantics-preserving perturbations [3], semantic consistency and robustness [4,5], and semantic clustering/equivalence of outputs [6,7,8]. In that context, a theorem showing that nuisance variation can affect output distributions when meaning is fixed does not by itself feel like a major discovery.
(2) Because of this, I think the related-work discussion and positioning need to be strengthened substantially. In particular, I would like to see a clearer discussion of how the proposed framework differs from existing work on semantic consistency, semantics-preserving perturbations, semantic clustering of outputs, and distribution-based sensitivity analysis [1-8]. More generally, if the key claim is that raw output-distribution comparisons do not identify semantic sensitivity without additional assumptions, then it is not clear to me what gap remains despite these increasingly semantics-aware approaches. I also found it difficult to interpret the practical significance of some reported improvements, as several reductions are presented as large percentage gains while corresponding to relatively small absolute changes in the sensitivity metric.
Refs: [1] Rauba et al. (2024), Distribution-based Sensitivity Analysis for Large Language Models. [2] Rauba et al. (2025), Statistical Hypothesis Testing for Auditing Robustness in Language Models. [3] Romanou et al. (2026), Brittlebench: Quantifying LLM Robustness via Prompt Sensitivity. [4] Hejabi et al. (2026), Flip-Flop Consistency: Unsupervised Training for Robustness to Prompt Perturbations in LLMs. [5] Pinneri et al (2025), Guarding the Meaning: Self-Supervised Training for Semantic Robustness in Guard Models. [6] Nguyen et al. (2025), Beyond Semantic Entropy: Boosting LLM Uncertainty Quantification with Pairwise Semantic Similarity. [7] Kunitomo-Jacquin et al. (2026), Evidential Semantic Entropy for LLM Uncertainty Quantification. [8] Karimi et al. (2026), LLMs Uncertainty Quantification via Adaptive Conformal Semantic Entropy.
Questions for authors
Following the weaknesses discussed above, recent work already studies distribution-based auditing, semantics-preserving perturbations, semantic consistency/robustness, and semantic clustering of outputs [1-8]. Could the authors clarify what gap remains despite the number of semantics-aware contemporary approaches , and why the nuisance-confounding problem identified in this paper should be viewed as a distinct contribution rather than a formalization of limitations that are already recognized by this literature?
We thank the reviewer for the thoughtful feedback. We clarify our distinction from prior work, emphasizing the theoretical formulation of nuisance-induced confounding and its empirical implications.
Distinction from Prior Work and Theoretical Contribution
Our contribution is not the first observation that surface-form variation affects LLM outputs. Rather, we formalize nuisance-induced confounding as a structural measurement problem in distribution-based sensitivity analysis, establish a criterion for nuisance-invariant representations, and connect this criterion to a practical normalization mechanism.
Distribution-based sensitivity analysis [1–2] provides methods for quantifying changes in LLM outputs. In particular, [2] constructs distributions in a semantic-similarity space and evaluates perturbation discrimination using FPR, TPR, and AUC. However, semantic-similarity-based comparison does not by itself ensure that measured sensitivity isolates task-relevant semantic changes. Nuisance-dependent output variation can induce nonzero distributional sensitivity even at the population level when underlying meaning remains unchanged.
Theorem 1 formalizes this limitation through a meaning–nuisance mixture model, showing that shifts in nuisance mixing weights can alter raw-output distributions even when meaning is fixed. Proposition 1 then provides a sufficient condition for avoiding such confounding: conditional independence of the representation from nuisance given meaning. Eq. (7)'s conditional information bottleneck (CIB) objective expresses the corresponding design goals of preserving meaning-related information and suppressing nuisance dependence.
Semantics-preserving perturbation and robustness studies [3–5] examine model behavior under input variations. [3] BrittleBench decomposes performance variability, while [4–5] study prediction consistency and semantic robustness. These studies also address nuisance-related variability; our complementary focus is how such variation confounds the interpretation of distribution-based output sensitivity.
Semantic uncertainty studies [6–8] use semantic similarity or clustering to estimate uncertainty over generated meanings. While these methods account for linguistic variation, our focus is on whether distributional sensitivity across input conditions can be attributed to task-relevant meaning changes rather than nuisance variation.
Motivated by this formulation, we introduce summary-based semantic normalization as a practical approximation to nuisance-invariant representations. Holding generated responses and sensitivity computation fixed, we compare Raw, Prefix Truncation, Format-Only, Extractive Length-Matched, and Summary to assess nuisance suppression and semantic discrimination (Table 4). Table 5 further examines nuisance-information suppression and task-relevant semantic information retention.
Absolute Sensitivity Changes and Discrimination Performance
We agree that relative percentage reductions alone do not establish practical significance. Table 2 reports the following absolute changes in the controlled refund-policy task:
Summary reduced nuisance sensitivity while increasing semantic sensitivity, rather than uniformly suppressing both. The paired Summary–Raw ΔAUC was +0.4323 [0.2943, 0.4818] based on 5,000 bootstrap resamples.
We also revalidated the length-matched extractive control, achieving exact Gemma token-length matching for 320/320 response pairs. Under the same local encoder configuration, Extractive achieved an AUC of 0.7135, versus 0.8854 for Summary. The paired difference remained +0.1719 [0.0625, 0.3282], indicating an improvement beyond length reduction alone.
Additionally, Appendix D.3.4 reports an average nuisance-sensitivity reduction of 0.0343 [0.0257, 0.0445] after adjusting for same-input generation variability in low-Raw-sensitivity settings, with reductions in 49/64 task–condition–encoder combinations.
These results demonstrate that the contribution is not limited to relative reductions in sensitivity scores: summary-based normalization improves discrimination between the evaluated semantic and nuisance perturbations, providing empirical support for the measurement framework developed in our theoretical analysis.