acceptodds
Under review as a conference paper at ICLR 2027

Rambling on Repeat? Exact First-Exit Laws and Minimal Intervention for Verbatim LLM Loops

Abstract

Modern LLM generations occasionally enter verbatim repetition and run to their output caps, wasting user token budgets, increasing request latency, exhausting computing power, and exposing a system vulnerability. Existing repetition penalties and -gram bans are global heuristics that distort healthy text but neither estimate a detected loop's persistence nor certify exit. We combine serving-stack signals and rigorous first-exit theory to quantify and control this behavior with guarantees on minimum intervention cost. Temperature- decoding samples the Boltzmann distribution over token energies, making the runner-up gap an activation energy. Hazard products along one greedy trace give the exact finite-horizon distribution of exit time and phase at any temperature. If a measured lap repeats indefinitely, escape obeys an Arrhenius law governed by the cycle's minimum gap, with exits concentrating at that weakest phase. The parameter-free law is validated across 37 orbits from six families up to a 284B MoE model including its 3-bit quantization. Inverting it yields two training-free, event-triggered controllers for a user-specified risk tolerance : a provably minimal-temperature pulse that exits within a chosen horizon, and a stepwise minimum-KL guard that contains every detected trajectory within tokens at minimum compatible distortion, each with successful-exit probability at least . Deployed as a vLLM logits processor, the untuned guard raises Qwen3-4B sustained escape from 0.71 to 0.91 and reduces cap exceedance on 710 matched natural-workload prefixes from 30.7% to 5.1%.

Primary area:
generative models
Keywords:
large language models, LLM degeneration, decoding-time control, Arrhenius law, minimum-KL intervention, vLLM

Reviews

Among:
Shape:
1234this paper, Bottom 9%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.50 over 2 reviews, above 9% of the others.
Reviewer_yv95OpenReview ↗
Rating
2
Confidence
2
Informativeness
1
Presentation
1
Soundness
2
Read review
Paper summary

LLMs can enter verbatim repetition loops that run to their output caps, wasting tokens, latency and compute. Although these events are rare, especially for recent models, it is interesting to understand them better. This article proposed to do that through one quantity, the runner-up gap (top logit minus second logit), which governs how likely temperature sampling is to leave a loot at each step.

The main part of the article is devoted to developing a theory framed in terms of the “Arrhenius law” from physical chemistry. Under an idealized setting in which a recorded lap of the loop repeats unchanged, it derives the expected exit time and the position at which the loop is left (the smallest gap). This motivates two training-free controllers applied once a loop is detected: a “pulse” that raises the temperature briefly at the weakest positions, and a “guard” that, at each step of a detected repeat, minimally rescales the next-token distribution so that the repeat is broken within L tokens with probability at least 1-\delta.

Contributions:

(1) The measurement that loops deepen: the runner-up gap grows lap after lap before leveling off. (2) A simple, implementable guard with a clean probabilistic guarantee. (3) The pulse, a minimal-temperature intervention, tested on GPT-2.

Critical strengths

(1) A simple, deployable guard with a checkable guarantee. Once a verbatim repeat is detected, the guard minimal rescales the next-token distribution so that the repeat is broken within L tokens with probability 1-\delta, which is supported by the experiments.

(2) The empirical insight of runner-up raising lap after lap before leveling off on GPT-2 (and somewhat similar behavior in other models). This gives a quantitive picture of self-reinforcing repetition and why loops become harder to escape the longer they last.

Critical weaknesses

(1) The validation of the theory is circular and its key assumption is contradicted by the paper’s data. The exit-time law (Theorem 2(ii)) and the pulse guarantee (Prop. 1) assume that the logits of one recorded lap repeat unchanged (the “frozen profile”). This is stated only in passing inside the theorem statement. In the abstract, it says “if a measured lap repeats indefinitely”, which can be read as if only the tokens need to repeat (true for any loop) but they actually mean the logits need to repeat, which the paper’s own data contradicts (e.g. the “flagship” loop’s per-lap confidence rises from 0.56 to 0.97. The paper claims a parameter-free exit law “validated across 37 orbits”.

(2) The (overcomplicated) theory blurs the simplicity of the method. The use of physics vocabulary is used mostly decoratively. Theorem 1’s bounds are vacuous at operating temperatures. There are several undefined terms (“matcher-live step”, “trajectory”, “re-traversal”, etc), “exit” can mean three different things, the probability spaces are unspecified. A comparison with existing methods like the DRY sampler and detecting the loop and stoping or restarting is missing.

Questions for authors

(1) As far as I can see, the paper’s conclusion rest on elementary facts, for example: (i) softmax with temperature depends only on \Delta / T, so a larger gap acts like a lower temperature, (ii) the chain rule, which gives the survival probability along a recorded trace,

Which of the results requires the Arrhenius / statistical-physics framing? In particular, the guard, used for the main experimental results, does not use Theorems 1-3. Why not presenting the theoretical framework with the minimal mathematics (and leave the physical intuition for the appendix) so the experiments can be explained in the main text, since this is the main contribution?

Reviewer_zkLDOpenReview ↗
Rating
1
Confidence
2
Informativeness
1
Presentation
1
Soundness
1
Read review
Paper summary

This paper seems to solve the verbatim repetition issue in the auto-regressive decoding. However, the authors failed to give the specific reason of such issues and corresponding solutions. For instance, the ratio or specific cases of verbatim repetition issue are not mentioned with details. Also, the so-called conditional law, as the first contribution, is also unclear. I did try my best to read the Theorem 1 but did not see why it can solve this verbatim repetition issue. The experiments are also unclear. For instance, in Appendix C, the prompts for the experiments are not given as well. I think it is very difficult to represent the results of this paper. Anyway, the paper is extremely hard to understand and I suggest a strong reject.

Critical strengths

None.

Critical weaknesses
  • The challenge solved by this paper is not clear.
  • The contribution of this paper is not clear.
  • The results are hard to represent.
Questions for authors

Is this paper mostly generated by LLMs?

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.