- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes UG-TTT, which adds a LoRA policy ensemble, a token-disagreement bonus, and nuclear-norm regularization to TTT-DISCOVER (ICML 2026). The paper evaluates maximum verifier reward and program diversity under a 384-rollout budget on six tasks, with additional seed, model, and component studies.
Critical strengths
- The paper addresses a practically relevant question in verifier-guided program search.
- The appendices provide substantial implementation detail and openly report mixed results and limitations.
Critical weaknesses
- Limited insight and insufficient isolation of the proposed mechanism
W1 — Limited methodological insight. The method largely combines established ensemble disagreement and reward shaping with TTT-DISCOVER. Propositions 1–3 establish elementary component properties, not conditions linking the proposed proxy to useful exploration; the empirical analysis does not establish a compelling mechanism either (Section 2; Appendix E).
W2 — The disagreement bonus is not adequately isolated. No frozen-ensemble control separates adaptation from diversified initial sampling. In Table 3, MI and the entropy comparator also differ in vocabulary coverage and aggregation, preventing a clean assessment of the particular disagreement signal (Section 3.3; Limitations).
- Limited empirical support for a reliable practical advantage
W3 — Nonuniform and thin comparisons. CP26 seed 42 uses a degenerate five-member comparator, while AC1 seed 42 changes stopping only for UG-TTT. With at most three run pairs per task and mixed seed outcomes, the headline results do not establish a robust advantage under a consistent comparison protocol (Tables 1–2).
W4 — Practical benefit remains insufficiently established. Matching rollout counts does not match total compute, given the ensemble’s additional scoring and backward passes. The strongest denoising gains are measured on the repeatedly queried search verifier, without untouched evaluation (Section 3; Appendix B).
Questions for authors
- Regarding W1: Beyond assembling the components, what specific new insight about effective exploration is established, and which result supports it?
- Regarding W2: What evidence separates the MI bonus from diversified ensemble sampling and from a full-vocabulary entropy bonus with matched aggregation?
- Regarding W3: Which gains are reproducible against a standard single-adapter baseline when both arms use matched stopping and a consistent protocol across seeds?
- Regarding W4: Does the method retain an advantage under matched total compute? Do the selected denoisers improve performance on data never queried during search?