- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper works on unsupervised elicitation: inferring labels for a set of binary training claims (e.g., whether a math solution is correct, or whether one response is more helpful than another) purely from a pretrained base model’s own log-probabilities, with the aim that these self-generated labels, when used as many-shot demonstrations, yield test accuracy close to that obtained with ground-truth-labeled demonstrations. Previous methods, such as Internal Coherence Maximization (ICM), use simulated annealing under logical-consistency constraints to search for the labeling that maximizes mutual predictability, the summed log-probability of each label when all other labeled examples are given in context. The authors argue that since changing any one label alters the context of every term, each search step must rescore the entire labeled set, making ICM roughly quadratic in forward passes and dependent on per-dataset hyperparameter tuning, while simpler bootstrapping methods are linear but drop the mutual-predictability objective altogether. To address this, they propose Linear-Cost Unsupervised Elicitation (LC-UE), which first labels consistency groups in one single pass ordered by zero-shot confidence, each conditioned on all previously labeled groups, and then runs a few refinement sweeps in which label changes for every group are proposed in parallel from their direct effect on mutual predictability against a frozen context, with a sweep kept only if one exact recomputation of mutual predictability confirms an improvement; logical consistency is enforced as a hard constraint in both phases. The authors derive a total cost of forward passes for claims and sweeps, with sweeps stopping after two to three on average. Across five benchmarks (TruthfulQA, GSM8K-verification, Alpaca, GlobalOpinionQA, and OpinionQA) with Llama 3.1 8B and 70B base models, they report many-shot test accuracy that matches or exceeds ICM and two iterative-bootstrapping variants, using an estimated 228–555× fewer forward passes than ICM on the three larger training sets.
Critical strengths
- Targets a real and interesting bottleneck of unsupervised elicitation. The quadratic cost of ICM is resource-intensive: it is corroborated by Shrivastava et al. (2026), Mahbub et al. (2026), and the authors' own controlled run, in which ICM at ran for over five hours and labeled only 101 of 256 claims on the same hardware where the full LC-UE pipeline finishes in under an hour (Section 4.2, Figure 4).
- A simple, well-reasoned design. The method follows directly from a clear diagnosis of why mutual predictability is expensive: the paper separates the direct effect of a group's labels on its own terms from the indirect effect on every other claim's context, scores only the former against a frozen snapshot, and uses a single exact recomputation per sweep as a safeguard (Section 3.3).
- Transparent cost accounting. The cost derivation is explicit, and the reported reduction factors can be reproduced from the stated values of , , and (Section 3.4). The authors count the final, discarded sweep toward cost rather than only accepted sweeps, report a conservative bound at the sweep cap alongside the realized cost, and explain why the run is cheaper than the run (Section 4.2).
- Experimental results are significant. The evaluation spans verification, truthfulness, pairwise preference, and two pluralistic-alignment benchmarks. Across all five benchmarks, LC-UE's accuracy is at or above the ICM numbers it is compared against.
Critical weaknesses
- The paper motivates itself with post-training but never shows that its labels are useful for it. The abstract opens with “Post-training language models depend on human annotators for labels, which becomes a bottleneck as models grow more capable,” and the introduction and conclusion keep this framing. Yet no experiment post-trains anything; the inferred labels are only used as in-context demonstrations, and the reported metric is how close this gets to many-shot prompting with gold labels. I suggest either adding a fine-tuning experiment with LC-UE labels or rewriting the abstract and introduction around in-context label inference.
- It is unclear whether keeping mutual predictability is what makes LC-UE better than bootstrapping. The paper's main distinction from Shrivastava et al. (2026) is that it restores the MP objective, yet Phase 1 alone, which does not use MP, combines confidence ordering, bootstrapping, and hard consistency, whereas each of the two bootstrap baselines uses only one of the first and the last. Phase 1 results are shown only in Figure 5b for two benchmarks, without exact numbers; reading the bars, Phase 1 alone already reaches about 71.6 on GSM8K-verification and 87.0 on TruthfulQA, above both bootstrap baselines (71.1 and 86.1), and Phase 2 adds only about 0.2 points on GSM8K-verification. The gains over bootstrapping may therefore come from combining these components rather than from MP.
- The baseline comparisons are not run under matched conditions. The ICM numbers on three benchmarks are copied from Wen et al. (2025a) rather than re-run, with a different TruthfulQA training set (2,604 vs. 2,560 claims) and possibly a different prompt template (see Q1), while the bootstrap baselines are re-run with unspecified settings and fall unusually far below ICM on OpinionQA (71.4 vs. 82.2), unlike the near-ICM results Shrivastava et al. (2026) report elsewhere (see Q2). In addition, all results come from a single run, and the error bars in Figure 3 are not explained, so several margins of one point or less (e.g., 0.8 over Confident Bootstrap on GSM8K-verification, 0.5 and 0.1 over ICM on GOQA and OpinionQA) cannot be judged.
- The cost comparison uses an unequal unit and the wrong reference point. The forward passes are counted assuming they cost the same, but Phase 1 reuses a KV cache and processes only each new group, whereas every Phase 2 pass processes up to 1,302 demonstrations from scratch (Appendix G), and the ICM counts are extrapolated from an iterations-per-datapoint value measured at to . More importantly, the headline 228–555× reductions are relative to ICM, while the relevant comparison is bootstrapping, which is also linear; the caption of Figure 1b itself notes that the bootstrap variants use shorter contexts and hence less compute, yet their cost is never reported.
Questions for authors
- Do LC-UE's prompts use the same template as the ICM results you compare against? The ICM numbers on three benchmarks are copied from Wen et al. (2025a), whose reference prompt ends with a trailing space that Shrivastava et al. (2026) report can depress Llama's accuracy, and Appendix C does not say whether LC-UE's prompts share it. If they do not, part of the margin over ICM (e.g., +3.0 on GSM8K-verification, +4.0 on Alpaca) may come from prompt formatting rather than the method. Could the authors report LC-UE under the original template, or re-run ICM under yours at as you already did in Section 4.2?
- What settings were used for the re-run bootstrap baselines? LC-UE uses 2,560 / 256 / 160 test-time demonstrations on TruthfulQA / GSM8K-verification / Alpaca and 20 on GOQA/OQA, whereas Shrivastava et al. (2026) evaluate with 128 shots. Please state the test-time demonstration counts, subset sizes, and number of rounds for both bootstrap variants, especially on OpinionQA, where Consistent Bootstrap (71.4) falls far below ICM (82.2). If these differ from LC-UE's, could you report the baselines under matched settings? Otherwise, the comparison with baselines could be unfair.
- Why is it worth keeping mutual predictability as the objective? The paper’s motivation is to keep ICM’s MP objective while removing its search, but it offers little evidence that optimizing MP improves accuracy. Phase 1, which does not use MP, already achieves: in Figure 5b, Phase 2 adds about 2.7 points on TruthfulQA, but only about 0.2 on GSM8K-verification, and no Phase 1 results are shown for the other three benchmarks. Could you report the exact Phase 1-only test accuracy on all five benchmarks, or otherwise explain why MP should help beyond confidence-ordered bootstrapping with hard consistency?
3 comments
Response (2/2)
W1. The post-training framing.
We agree. In the revised version, we have rewritten the abstract and introduction around in-context label inference and listed fine-tuning as a limitation (Section 6). Our response to Reviewer JYC4 gives further evidence on the quality of the full labeled set, including training-set label accuracy.
W3. Single runs and error bars.
The error bars in Figure 3 show the standard deviation over three evaluation runs on the test set, all using the same elicited labels. Although scoring uses temperature 0, GPU inference is not perfectly deterministic, so test predictions vary slightly between runs. These error bars therefore capture only evaluation noise, not variation in the labels themselves. The reviewer is right that each set of labels comes from a single run of the pipeline, and we have stated this clearly in the revised caption of Figure 3.
Our new ordering experiments give a sense of how much the labels themselves vary between runs. Across independent Phase 1 runs with different random orders, test accuracy had a standard deviation of 0.2 to 1.3 points on Alpaca, GSM8K-verification, and TruthfulQA (Table 12, Appendix H; see also our response to Reviewer JYC4). Given variation of this size, we agree that margins of one point or less should be read as ties, not improvements.
W4. The cost comparison.
We agree on both points.
First, forward passes are not all equal, so we measured cost directly. All runs below are on TruthfulQA with 2× RTX PRO 6000 GPUs:
| Method | n | Wall-Clock | GPU-hours |
|---|---|---|---|
| LC-UE | 256 | 0.84 h | 1.7 |
| ICM (measured; labeled only 101 of 256 claims) | 256 | > 5.07 h | > 10.1 |
| Confident bootstrap | 2,604 | 0.15 h | 0.3 |
| Consistent bootstrap | 2,604 | 0.15 h | 0.3 |
| LC-UE | 2,604 | 4.50 h | 9.0 |
| ICM (extrapolated from n = 256) | 2,604 | ~525 h | ~1,050 |
Measured this way, LC-UE is about 117× faster than our extrapolated ICM cost at 2,604 claims, and at least 6× faster at 256 claims, where ICM did not even finish. These ratios are smaller than the forward-pass ratios in the paper, and we have added wall-clock time and GPU-hours to the revised version (Section 4.2, Table 1).
Second, the reviewer is right that bootstrapping is the more relevant comparison. Both bootstrap variants are also linear, and LC-UE costs about 30× more than they do. That extra cost is the price of the refinement step, and Q3 shows what it buys. LC-UE's large cost advantage is therefore over ICM only, and we have made this explicit in the revised version (Section 4.2).
On the ICM estimates: as the reviewer notes, the iterations-per-datapoint value r was measured at 128 claims. However, in our own run at 256 claims, ICM had labeled only 101 claims after the number of iterations that r predicts. If anything, our extrapolated costs underestimate ICM's true cost.
Thank you for your response. I consider Phase 2 to be the most important and novel component of the proposed design. However, the performance gains attributable to Phase 2 appear modest, though it consistently avoids performance degradation. I believe the author should provide a clearer explanation of when and why Phase 2 yields significant performance gains on some tasks but not others, such as GlobalOpinionQA, where phase 2 only improves by 0.2. Therefore, I will maintain my score.
Response (1/2)
We thank the reviewer for the careful and constructive review. We answer the questions first, then address the remaining weaknesses.
Q1. Do LC-UE's prompts use the same template as ICM?
Yes. LC-UE uses exactly the same prompt templates as the original ICM implementation (Wen et al., 2025a), including the trailing space the reviewer mentions. Any effect of prompt formatting therefore applies equally to both methods and cannot explain the margins over ICM.
The one remaining difference is that our TruthfulQA training set has 2,604 claims instead of 2,560. At test time, though, we use 2,560 labeled demonstrations, as ICM does. For a fully controlled comparison, we also ran ICM ourselves at 256 claims, with the same model, hardware, and prompts as LC-UE (Section 4.2).
Q2. What settings were used for the bootstrap baselines?
All methods, including both bootstrap baselines, use the same number of test-time demonstrations: 2,560 on TruthfulQA, 256 on GSM8K-verification, 160 on Alpaca, and 20 on GlobalOpinionQA and OpinionQA.
For the bootstrap baselines themselves, we followed Shrivastava et al. (2026): subsets of 512 examples and three rounds of labeling (0-shot, then 8-shot, then 128-shot). For the confident bootstrap, the demonstrations carried between rounds are limited to the 64 most confident True and 64 most confident False predictions. For the consistent bootstrap, the consistency rules are applied to each round's predictions. The revised version describes these settings in full (Appendix C.3).
We used these same settings on every benchmark, so the larger gap between the bootstrap baselines and ICM on OpinionQA is not due to different tuning. We do not yet have a full explanation for it.
Q3. Why keep mutual predictability as the objective? (also W2)
We agree with the reviewer's reading. Much of LC-UE's advantage over the bootstrap baselines comes from combining bootstrapping with hard consistency constraints in a single pass, not from mutual predictability alone. Here are the exact Phase 1 results on all five benchmarks (Table 13, Appendix I):
Phase 2's gains are modest and vary by dataset. We still think it is worth keeping, for three reasons:
In the revised version, we have reframed the contribution to match (Section 1 and Section 5.2): a linear-cost method that combines these components and adds a verified refinement step, rather than a claim that mutual predictability is the main source of the gains.