acceptodds
Under review as a conference paper at ICLR 2027

Do LLMs Follow a Behavioral SCRIPT? Measuring Structural Choreography and Rigidity from Positions and Transitions

Abstract

Individual-response evaluations can rate an answer highly while failing to assess whether a model consistently organizes its behaviour in the same way across users. To measure this, we introduce **Script**, the **S**tructural **C**horeography and **R**igidity **I**ndex from **P**ositions and **T**ransitions, a reference-free measure of behavioural scriptedness from span annotations. Script separates positional choreography from sequential momentum and calibrates both against a within-response permutation baseline that preserves behaviour frequency while disrupting arrangement. We evaluate it on 4,095 responses to 819 counselling prompts from five frontier models with matched therapist responses, and on 22 controlled prompting and training configurations. All five models exhibit recurring structure above the permutation baseline (–), while the matched therapist shows lower positional choreography under the same annotation scheme. For the models, response position explains substantially more behavioural variation than coded user state or conversation stage, and models respond more strongly to explicit cues than to affective distress. At matched behaviour mix, existing quality evaluation shows no detectable sensitivity to arrangement, and reducing cross-turn tactic recurrence does not necessarily remove within-response choreography. These findings identify behavioural arrangement as a distinct evaluation dimension and provide a practical framework for measuring not only what models do, but where and in what sequence they repeatedly do it. We release all analyses and codes.

Primary area:
foundation or frontier models, including LLMs
Keywords:
large language models, LLM evaluation, behavioral evaluation, behavioral scriptedness, response structure, model behavior, human-ai interaction, alignment, response diversity

Reviews

Among:
Shape:
1234this paper, Top 30%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.67 over 3 reviews, above 70% of the others.
Reviewer_ZSy4OpenReview ↗
Rating
3
Confidence
2
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

This paper proposes a metric to quantify the recurrence of behavioral patterns in an LLM's response, which is an axis distinct from measuring other forms of the quality of the response. This metric disentangles the relative position of the behavior from the sequential associations between different behaviors. The methodology for computing this metric can also be applied to quantify the recurrence of behavioral patterns throughout a conversation rather than merely within individual responses. The authors also explain how this metric can be standardized for use across different behavioral schemes.

The paper shows that for individual responses, nearly all of the explored LLMs exhibit similar recurrence of behavioral patterns, which is higher than the recurrence for human responses. For the conversation-level analysis, results show that LLMs behave consistently with humans relative to the user's state, and differ slightly with regard to the conversation turn.

The calculation of these metrics requires profiling the LLM, pooling the relative positions of each behavior and the transition from one behavior to another. Once such profiles are created, the authors highlight how they can be used to detect the LLM that generated a given response.

Critical strengths
  1. I think the proposed metric itself is useful and might be applied in different use cases. Similar to what the authors showed, it might be used for LLM watermarking, and it can also be used as an automatic reward that's applied during model training to encourage generating more diverse patterns (or more recurrent patterns, depending on the application).
  2. The method is mathematically rigorous to a good extent. An example of this is the disentanglement of choreography from momentum while also conditioning the momentum on choreography (this is how the measure of momentum can be isolated).
Critical weaknesses
  1. Most of the results focus on showcasing the use of the proposed metric rather than validating whether the metric is reliable or not. The authors included a paragraph on that in the main body, but deferred all validation experiments to the appendix. Since the main contribution of the paper is the introduction of this metric, I think it's important to focus more on rigorously testing the validity and limits of this metric before showcasing its use. The experiments in the main body are only interpretable under the assumption that the metric works as intended.

  2. Most of the results shown in the main body rely on annotations from a judge LLM. That's generally fine when the judge is validated, but the appendix shows that the judge agrees with human annotators for only 24% of the labels (within the correctly highlighted characters). This is a relatively weak agreement, and it only involves the LLM responses; it doesn't include the human responses. This limits the reliability of the results and conclusions from the conversation-level analysis in table 3 (the within-response results in table 2 also involve the judge, but the authors mention that these are similar to other results that were human-annotated, so those might be fine)

  3. Based on the results in table 2, almost all models (except for claude) exhibit similar choreography and momentum (no statistical significance). Figure 3a shows that, given a response and several LLM profiles, one can detect the LLM that generated the response. Connecting both of these facts, it might be that the SCRIPT metric itself is limited in its ability to measure behavioral scriptedness and that a more representative metric can be computed from these profiles (the position and transition tables). Please let me know if I'm missing something in this interpretation.

  4. (less critical but worth noting): the paper was hard to follow. For example, the purpose of the abstract is to give a summary of the work, but this work used a lot of new terms in the abstract (choreography, momentum), confusing the reader. The authors also mentioned conversational choreography (with no introduction to it) in one paragraph, described it in a later paragraph, and didn't end up using it in the main body. These are just examples suggesting that the manuscript needs substantial revision for better clarity.

  5. (more of a comment than a weakness): The authors mention that this metric is reference-free. I think this is not worth claiming because, in all cases, one has to compare one model's SCRIPT metric to another model/human's metric (the absolute number isn't intuitive or meaningful), so "reference-free" doesn't really make sense.

Questions for authors

The authors use characters, not LLM tokens or words, to obtain the start of a span and subsequently compute the relative start position. Why is that the case?

5 comments

We thank the reviewer for recognizing SCRIPT's contributions. To improve the clarity and accessibility of the methodology, we have also updated our project website (scriptmetric.com) with an interactive, step-by-step example demonstrating how SCRIPT is computed from a real conversation.

W1.

1. Every SCRIPT score includes a comparison with chance.

We compare real responses with 200 shuffled versions of the same responses and this comparison establishes reliability and validity of SCRIPT, preserving exactly which behaviours occur and how often, while changing their arrangement.

Thus, every score measures structure beyond what behaviour frequency and random ordering would explain. Table 2 reports the corresponding z-scores (22–44), and its random-label control returns approximately zero (−0.004).

2. Two new analyses (Total of six validation tests)

What do we test?EvidenceResult
No script → zeroRandom data, shuffled real labels, translation errors≈0
Planted script → detectedFixed positions vs. fixed behavioural chains0.853 in C; 0.238 in M
More script → higher score (new)Preserve 0–100% of original orderingMonotonic increase across all 5 models
Robust to statistical biasSkewed labels and small samplesRaw score reaches 0.33; SCRIPT stays within ±0.011 of zero
Robust to methodologyAlternative annotators, estimators, bins, and independent implementationMain structural findings persist; implementation agrees within ±0.001
Distinguishes meaningful groups (new)Expert-rated high- vs. low-quality counsellingPositional C: 0.010 vs. 0.042 (p = 0.016)

W2.

We tested Table 3 using three alternative annotation approaches, and the main findings remain consistent.

1. What does the 24% agreement mean?

The 23.6% exact-code agreement combines two types of labels:

  • Observable behaviours: Agreement is higher for open questions (73%), normalizing (65%), recommendations (57%), closed questions (57%), validation (55%), and directives (50%).
  • Clinical judgments: Agreement is much lower for subjective labels, such as whether empathy accurately reflects the user's experience.

2. Robustness checks: Do the findings change with different annotators?

We repeated Table 3 using only the six better-agreed codes and a position-blind rule-based annotator that labels each sentence independently.

Key findingAll 20 codesSix codesRule-based
Therapist advice: low → high emotion29% → 13%45% → 23%27% → 9%
Largest model advice change~5 points5.4 points8.3 points
Therapist advice: early → late turns8% → 28%14% → 44%7% → 27%
Models: position vs. user-state association5.2–7.6% vs. 0.5–1.2%9.6–12.0% vs. 0.0–1.1%7.4–15.4% vs. ≤1.5%

The same pattern appears across all three approaches: Therapist advice decreases substantially as emotional intensity rises, while models change much less. Response position also remains more strongly associated with model behaviour than the coded user state.

3. New check: Can we reproduce the findings using only clinician annotations?

Since clinicians annotated all model responses, we independently repeated the model analysis without using the LLM judge.

Change in model advice (percentage points)Clinician labelsLLM annotator
Low → high emotion−4.8 to +2.9−5.0 to +5.2
Early → late turns−1.9 to +7.5−1.4 to +10.3

Neither annotation approach shows the large reduction in advice observed for the therapist (−16 percentage points). This supports the conclusion that models adjust their advice less in response to increased emotional intensity.

W3.

SCRIPT is already computed from the position and transition profiles:

  • SCRIPT score: How strongly does a model follow a recurring pattern, beyond chance?
  • SCRIPT profile: What does that pattern look like, and how does it differ between models?

1. Why can profiles distinguish models with similar SCRIPT scores?

Because models differ not only in how consistently they arrange behaviours, but also in which behaviours they use. SCRIPT controls for behaviour frequency by design, while profile-based identification uses both frequency and arrangement. For example, on held-out data (20% chance accuracy):

Information used1 reply5 replies20 replies
Full profile (position + transitions)38%57%74%
Behaviour frequency only35%48%60%
Full profile, shuffled order34%50%62%

2. Similar scores do not mean identical scripts.

Similar scores reflect a genuine similarity, not a lack of resolution. First, SCRIPT separates systems whenever their structure differs. It separates Claude from each of the other four models by Δ = 0.027–0.033 (Appendix B.5.1, Table B.23). When only prompting or training changes on a fixed task, positional choreography spreads the 22 Testbed 2 systems from C = 0.050 to 0.160, against 0.014 for human supporters (Appendix B.3, Table B.15). Second, the tie among the other four is measured precisely. Each score has a 95% interval of ±0.010–0.013 (Table B.23), so these models are scripted to the same degree within that precision.

W4.

We agree and will revise the manuscript to improve readability by:

  1. Simplifying the abstract and reducing technical terminology.
  2. Adding an intuitive example (empathy → advice → question) before introducing the equations.
  3. Defining C and M clearly: where behaviours occur and what follows what.
  4. Restructuring the paper: Present the metric and its validation first, followed by applications, and introduce conversation-level measures before using them.

These changes will make SCRIPT's novelty and findings easier to understand without sacrificing technical rigor.

W5.

We clarify that “reference-free” means SCRIPT does not require a gold-standard or human-written response, rather than that comparisons are unnecessary for interpreting its magnitude. SCRIPT is computed directly from a model's responses by comparing their behavioural arrangement with shuffled versions of those responses, while preserving behaviour frequencies. The score is meaningful on its own: 

  • SCRIPT ≈ 0 indicates no detectable structure beyond chance. 
  • SCRIPT > 0 indicates recurring structure, with the z-score quantifying statistical evidence.

Its magnitude is also interpretable. SCRIPT measures the additional share of behavioural uncertainty explained by position and preceding behaviour beyond the shuffled baseline. For example, SCRIPT = 0.10 indicates approximately 10% additional explained uncertainty (Appendix B.1). To provide further context, we normalize SCRIPT by a matched ceiling constructed from each corpus's existing behaviours. The five models reach 19–25% of this achievable rigidity (Appendix B.5.1).

Thus, human comparisons help contextualize the magnitude but are not required to compute or interpret SCRIPT. To avoid ambiguity, we will replace “reference-free” with “requires no reference response” throughout the manuscript.

Q1.

We use characters because they provide a consistent, precise measure of position across all models and human responses, without requiring a tokenizer. We chose characters for two reasons:

  1. Consistent across models: Different LLMs use different tokenizers, and three models in Testbed 1 are closed-source. Using one tokenizer would introduce an arbitrary choice. Characters work identically for all models and human therapists.
  2. Preserves behavioural order: Behaviours do not always align with sentence boundaries. In Testbed 1, 15% of highlights begin within a sentence, and 22% share a sentence with another highlight. Sentence-level positions can lose their order, while character positions preserve it.

New robustness test: Does the choice of unit change SCRIPT?

ModelCharactersWordsWords + punctuationSentences
Claude0.1180.1170.1150.073
GPT0.0980.0970.0980.072
Gemini0.0920.0930.0910.078
Qwen0.0910.0920.0920.075
Llama0.0830.0840.0830.085

Dear Reviewer,

Thank you for your time and review of our paper. We have provided a detailed rebuttal addressing all of your questions, along with several new analyses. We would greatly appreciate any further feedback and would be pleased to clarify any remaining concerns.

Thank you

Reviewer_XhSrOpenReview ↗
Rating
3(+1)
Confidence
3
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

This paper introduces SCRIPT, a reference-free metric for behavioral scriptedness in LLM responses. It decomposes behavioral structure into positional choreography and sequential momentum, using within-response permutations to control for behavioral frequency. Experiments show recurring behavioral patterns in LLM responses. The paper further investigates contextual responsiveness and finds that conventional quality evaluations may not capture behavioral arrangement.

Critical strengths
  1. This paper identifies an important limitation in current LLM evaluation. Behavioral arrangement as an underexplored dimension of LLM evaluation, beyond response quality and behavioral frequency.
  2. SCRIPT compares observed behavioral structure against a within-response permutation baseline that preserves each response's behavioral label multiset while disrupting the association between labels and positions. This is a sensible way to distinguish structural regularity from patterns that arise simply because certain behaviors occur more frequently.
  3. Experiments cover multiple models, annotation schemes, human responses, and training interventions, with extensive sensitivity analyses.
Critical weaknesses
  1. Limited construct validity: Behavioral regularity does not necessarily imply undesirable rigidity or poor contextual adaptation. The paper lacks direct evidence linking SCRIPT scores to user outcomes or response quality.
  2. Insufficient evidence for contextual insensitivity: The comparison between response position and user state relies primarily on separate associations rather than their independent contributions after controlling for relevant factors.
Questions for authors
  1. In Section 3.3, R=C+MR=C+M while CC is computed over all behavioral events and MM is estimated only from events with a preceding behavior. Could the authors clarify how this difference in sample support affects the information-theoretic interpretation of C+MC+M? Would the main findings remain consistent if both components were computed on a common event set?
  2. In Table 1 the authors mentioned 6,922 responses in Testbed 2, while 22 system configurations answering the same 315 turns would yield 22×315=6,930 responses. So where are the missing parts in this experiment settings?
  3. The paper introduces SCRIPT to measure behavioral arrangement, while prior work has investigated templatic empathic responses, cross-turn tactic recurrence, and behavioral fingerprints. Could the authors clarify the substantive novelty of SCRIPT relative to these approaches? In particular, beyond introducing a within-response permutation baseline, what capabilities or empirical insights does SCRIPT provide that existing methods cannot?
  4. The authors listed 19 codes in Table A.1, missing INC. But it appears in Table A.3 and the authors claimed 20 codes in Line 789. So why there is a mismatch here.
4 comments

We thank the reviewer for recognizing the importance of our work. To make the work easier to understand, we have also updated our project website (scriptmetric.com) with a step-by-step example.

- What does SCRIPT measure, and why does it matter?

A reply can be excellent on its own and still follow a template. We only see that template when many replies are placed side by side. Imagine users describing different emotional difficulties, yet the AI repeatedly responds with the same pattern: empathy at the beginning → advice in the middle → a question at the end.

SCRIPT makes this hidden structure measurable. It identifies (1) where behaviours repeatedly appear, (2) which behaviours tend to follow others, and (3) whether these patterns exceed what we would expect by chance, given the same behaviours.

W1.

We agree that recurring structure is not inherently harmful. SCRIPT measures behavioural organization, not clinical quality or harm. As stated in §1, the same pattern can be appropriate in one situation and problematic in another. To clarify its practical relevance, we conducted two additional analyses.

1. New analysis: Expert-rated counselling quality.

We examined 133 real counselling sessions from AnnoMI, grouped by expert-rated quality.

Counselling qualitySessionsPosition COrder MSCRIPT
High1100.0100.0340.043
Low230.0420.0050.046

The key finding is in the type of behavioural structure in addition to its overall magnitude. Although both groups exhibit comparable aggregate SCRIPT scores, lower-quality counselling shows significantly greater positional rigidity (p = 0.016).

2. New analysis: Does the behavioural order adapt to the user?

We directly test whether response organization changes with user context, matching model data to the therapist's sample size.

SpeakerSafety cueEmotional intensityConversation stage
TherapistYes (z = 5.5)No (z = −0.8)No (z = −0.3)
Five LLMsNo (z = 0.5–1.7)No (abs(z) ≤ 0.8)No (abs(z) ≤ 1.6)

When a user signals a safety risk, the therapist changes the order of their response, but none of the five models shows a detectable change.

3. Why existing quality evaluations miss this distinction.

In Testbed 2, we compare 25,919 pairs of responses containing the same behaviours in different orders. The quality judge gives nearly identical ratings (difference +0.004/5, 95% CI [−0.015, +0.022]; Table 4). The judge also rates human supporters lower than all 22 LLM configurations (2.90 vs. 3.22–4.67), illustrating why an automatic quality rating alone is insufficient.

W2.

Yes. We conducted a new analysis controlling for all three factors, and the main finding remains unchanged.

1. New analysis: What independently predicts model behaviour?

We fit a regression model using response position, user state, and conversation turn together. We then remove each factor separately to measure how much predictive information is lost. For example, does an AI give advice because the user needs it, or because advice usually appears in the middle of its responses?

SpeakerPositionUser stateRatio
Qwen6.6%0.51%13×
Llama8.3%0.18%47×
GPT7.7%0.32%24×
Claude5.6%0.46%12×
Gemini6.4%0.63%10×
Therapist5.0%1.14%4×

Key finding: Response position explains 10–47× more than the measured user state for LLMs, compared with 4× for the therapist. The therapist also shows 2–6× greater responsiveness to the measured user state.

2. Robustness: Does the finding depend on data size or annotation?

We repeated the analysis using:

  • Matched data size: Reducing each model's data to the therapist's sample size preserves the finding (position: 5.8–8.4%; user state: 0.09–0.61%).
  • Position-blind rule-based annotation: The finding also holds without an LLM annotator (models: position 7.3–17.0%, user state ≤0.6%).

3. Direct evidence of adaptation (W1): When users express safety risks, the therapist changes the ordering of behaviours (z = 5.5), while none of the five models shows a detectable change (z = 0.5–1.7). The new analyses show that the models' behavioural organization is more strongly associated with response position than with the measured user context.

Q1.

No. We recomputed SCRIPT using the same events for both components, and the main findings remain unchanged.

1. Why were different events used?

  • C (choreography) measures where behaviours appear, including the first behaviour.
  • M (momentum) measures what behaviour follows another. The first behaviour has no predecessor, so it is excluded.

For example, in empathy → advice → question, C uses all three behaviours, while M uses only advice and question.

Importantly, the observed score and its shuffled baseline always use the same event-selection rules, ensuring a fair comparison with chance.

2. New analysis: Both components computed on the same events.

We recomputed C, M, and H(L) using only events with a predecessor (57–66% of events). This makes the information-theoretic chain rule exact:

C+M=I(L;X,Lprev)H(L)C + M = \frac{I(L; X, L_{\mathrm{prev}})}{H(L)}

ModelOriginal SCRIPTCommon-set SCRIPTz
Qwen0.0910.08824.4
Llama0.0830.07618.2
GPT0.0980.09127.1
Claude0.1180.12041.6
Gemini0.0920.08323.7

All five models remain far above chance (z = 18–42), Claude remains highest, and positional choreography remains similar across models. Under the shared blind annotator, the therapist also remains less scripted (0.058 vs. 0.079–0.111 for models).

3. Why not add a start token?

Adding an artificial start token would allow the first behaviour to enter M, but it could also count the opening behaviour twice: once through its position (C) and again through its relationship to the start token (M). We will report the common-event-set results in Appendix C.1 and clarify the mathematical convention in §3.3.

Q2.

The dataset contains 22 configurations × 315 turns = 6,930 responses. However, eight responses received no behavioural labels from the released tactic tagger, leaving no events for SCRIPT to analyze. Therefore, 6,930 − 8 = 6,922 annotated responses. We will clarify this exclusion and the resulting count in Table 1.

Q3.

The novelty is not simply the permutation baseline. SCRIPT measures behavioural arrangement in ways existing approaches cannot. Previous work measures behaviour frequency, predefined templates, cross-turn repetition, or model fingerprints. SCRIPT instead discovers and measures recurring behavioural patterns without requiring a predefined script.

SCRIPT adds four capabilities:

  1. Discover hidden scripts: Identify where behaviours repeatedly appear (C) and what follows what (M), without specifying a pattern beforehand.
  2. Separate types of structure: Distinguish fixed positions (C) from behavioural sequences (M). For example, human counsellors show more sequential structure (M = 0.036, C = 0.011), while LLMs show predominantly positional structure.
  3. Measure structure beyond chance: Preserve the exact behaviours while shuffling their order. This matters: a previous hand-built template matches 83–90% of LLM responses, but still matches 36–46% after shuffling (Appendix B.3.1).
  4. Provide practical evaluation tools: Behavioural profiles identify the generating model from 20 held-out responses with 74% accuracy (20% chance), while SCRIPT-Seq detects recurring structure after a median of 34–43 responses, with anytime-valid error control.

Q4.

All 20 behaviour codes were included in our experiments. Table A.1 summarizes the codes associated with the benchmark's ten rated attributes (19 codes). INC (incoherence) is a separate code for incoherent text, such as broken fragments or stray headings, and is therefore not listed under those attributes.

INC is included in Table A.3 and in all SCRIPT calculations. It is rare (124 of 39,696 annotated spans), and our additional sensitivity check confirms that removing it does not change any model's SCRIPT score by more than 0.002. We will clarify Table A.1's scope and explicitly list INC as the twentieth code to avoid confusion.

Dear Reviewer,

Thank you for your time and review of our paper. We have provided a detailed rebuttal addressing all of your questions, along with several new analyses. We would greatly appreciate any further feedback and would be pleased to clarify any remaining concerns.

Thank you

Dear Reviewer,

Thank you for the thorough review and for raising your score!

Regards,

The Authors

Reviewer_9aC8OpenReview ↗
Rating
2
Confidence
4
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

This work introduced SCRIPT, a reference-free measure of behavioural scriptedness from span annotations to assess the extent a model consistently organizes its behaviour in the same way across users. It can separate positional choreography from sequential momentum and calibrates both against a within-response permutation baseline that preserves behaviour frequency while disrupting arrangement. Evaluate is conducted on on 4,095 responses to 819 counselling prompts from five models. The findings identify behavioural arrangement as a distinct evaluation dimension and this work provides a practical framework for the measurement.

Critical strengths
  • This work introduced a neew measure of behavioural scriptedness that measures the extent to which a system repeatedly follows a similar behavioural structure across its responses. The measure can be used in a boarder scenario.
  • The proposed measure is comphrensively evaluated across models, human responses, interventions, annotation schemes, and controls.
Critical weaknesses
  • My main concern is the validity of SCRIPT as a measure. The main results show that all five models exhibit recurring structure above the permutation baseline, with SCRIPT scores ranging from 0.083 to 0.118. However, these differences appear relatively small, and the paper does not establish whether they are statistically significant. The claim that the models exhibit recurring structure may therefore be overstated.
  • The main contribution is SCRIPT, which is evaluated on two testbeds and across five LLMs. However, it is unclear whether evaluating only five models is sufficient to support the paper’s claims. Please clarify the criteria used to select these models and discuss the limitations of this evaluation scope.
Questions for authors
  • What is the selection crieria for the two testbeds and five LLMs?
  • If I use the SCRIPT as a measure, how can I know if a difference matters for two experimental settings?
4 comments

We thank the reviewer for recognizing SCRIPT's potential and would like to clarify what SCRIPT measures and why it’s meaningful. To make the methodology easier to understand, we updated our anonymous project website (scriptmetric.com) with a step-by-step example.

What is SCRIPT, and why does it matter?

A reply can be excellent on its own and still follow a template. We only see that template when many replies are placed side by side. Imagine users describing different emotional difficulties, yet the AI repeatedly responds with the same pattern:

empathy at the beginning → advice in the middle → a question at the end.

Each reply may be helpful individually. But is the AI adapting its behaviour to the person, or repeatedly following the same routine?

SCRIPT makes this hidden structure measurable. It identifies (1) where behaviours repeatedly appear, (2) which behaviours tend to follow others, and (3) whether these patterns exceed what we would expect by chance, given the same behaviours.

W1. Yes. All five models show strong statistical evidence of recurring structure, and the scores are meaningful relative to the achievable scale. We validate this through four checks:

1. Does SCRIPT detect genuine structure beyond chance?

We randomly shuffle behaviours within each response 200 times, preserving their frequencies but removing their arrangement. All five models show strong evidence of structure (z = 22–44), while the random-label control scores approximately zero (−0.004; Table 2). For a p-value we repeated the shuffle 10,000 times (new): every shuffled version scores below the model’s actual responses, so p < 0.0001 for each model.

ModelSCRIPT95% CIzMax shuffleCeiling
Claude0.1180.109–0.12843.90.00825%
GPT0.0980.088–0.10834.90.00620%
Gemini0.0920.081–0.10428.90.00819%
Qwen0.0910.081–0.10228.50.01019%
Llama0.0830.072–0.09422.10.01121%

2. How should we interpret the magnitude of SCRIPT?

The SCRIPT score measures the degree of behavioural rigidity. For example, a score of 0.10 indicates the extent to which behaviours consistently appear in particular positions and sequences, relative to randomized arrangements. To make the magnitude more interpretable, we construct a matched ceiling by placing each response’s existing behaviours in a consistent order (§3.3). The patterns are also observable:

  • 93% of eligible responses follow their model's learned structure more closely than shuffled alternatives (Appendix C.6).
  • In Claude's responses, advice follows validation 43% of the time, compared with 22% predicted by position alone (Fig. C.1).

3. New validation: SCRIPT increases with structure.

We preserve the original behavioural ordering in increasing proportions of responses (0–100%) and shuffle the remainder.

Model0%10%25%50%75%100%
Claude.001.007.017.040.078.118
GPT−.002.005.016.035.064.098
Gemini.000.003.014.037.062.092
Qwen.000.007.014.033.058.091
Llama.000.004.010.030.055.083

SCRIPT consistently rises for every model, from approximately zero with fully shuffled responses to the original score of 100%. Even 25% retained structure is detectable (z = 2.7–6.0). Synthetic known-answer tests independently confirm that SCRIPT detects planted positional patterns while returning approximately zero for random data (Table C.2).

W2.

Our evaluation is not limited to five models. Testbed 1 includes five frontier model families, while the broader evaluation covers 32 LLM output sets across 12 model variants, including 22 prompting/training configurations and independent support datasets. Importantly, the human–LLM comparison is consistent across four settings, using the same annotator and annotation scheme within each comparison (Appendix B.3):

DatasetLLM outputsLLM CHuman C
Testbed 15 frontier models0.063–0.0860.045
Testbed 222 configurations0.050–0.1600.014
Reddit supportGPT-4-turbo, Llama-3-70B0.101–0.1260.051
Real support chatsGPT-3.5,GPT-4, Llama-2-70B0.050–0.0660.009

In all four settings, human responses show lower positional choreography than the evaluated LLM outputs. The matched therapist comparison in Testbed 1 is statistically significant for all five models (Table 2).

Q1. Our selection follows three criteria: publicly available datasets, span-level behavioural annotations (existing or reproducibly generated), and sufficient volume of responses per system. Each testbed targets one of our research questions.

  • Testbed 1 — Are LLMs more scripted than humans? It provides 819 real counselling prompts from four corpora (including two multi-turn datasets), matched therapist responses, and outputs from five frontier models. We include all five models available in the benchmark, representing five developers (two open-weight, three closed): Qwen3.5, Llama-4, GPT-5.3, Claude Sonnet 4.6, and Gemini 3 Flash.
  • Testbed 2 — Can prompting or training change scriptedness? It provides 22 configurations from a single model family across the same 315 conversation turns, with fixed annotation and quality evaluation protocols. Importantly, it includes MINT, an intervention specifically designed to reduce repetition of tactics.

Additional datasets test different aspects of generality:

DatasetPurpose
WMT24 translation errorsExpected near-zero control
AnnoMI; human-written newsIndependent human references
Reddit posts; real support chatsHuman–LLM comparisons
Hallucination; data-to-text errorsCross-domain and annotation-scheme validation

These datasets test whether SCRIPT detects recurring structure across models, responds to interventions, and generalizes beyond counselling. We will clarify these selection criteria in §4.1.

Q2. We propose the following evaluation framework for comparing SCRIPT across models and interventions:

  1. Controlled evaluation: Evaluate models on the same user prompts using a consistent annotator and annotation scheme to ensure comparability.
  2. Statistical analysis: Estimate paired differences in SCRIPT using bootstrap resampling and report 95% confidence intervals to assess statistical significance.
  3. Effect-size analysis: Quantify changes in SCRIPT relative to the baseline model and assess the proportion of the model–human gap reduced by the intervention.

Example — Can we make AI responses less scripted?

We compare four methods against regular prompting on the same set of 315 conversations (Testbed 2).

MethodC scoreGap to humans closed
Regular prompting0.150Baseline
Verbalized sampling0.05074%
Tactic-list prompt0.11029%
MINT0.11228%
Quality-only RL0.1550%
Human responses0.014Reference

What does this tell us? Verbalized sampling substantially reduces scriptedness, MINT and tactic-list prompting reduce it moderately, and quality-only RL does not.

Interestingly, the existing quality judge gives MINT 4.67/5 and quality-only RL 4.62/5, yet SCRIPT reveals an important difference in how their behaviours are organized.

Dear Reviewer,

Thank you for your time and review of our paper. We have provided a detailed rebuttal addressing all of your questions, along with new analyses. We would greatly appreciate any further feedback and would be pleased to clarify any remaining concerns.

Thank you

Dear Reviewer,

As we are towards the end of the author-reviewer discussion phase, we respectfully inquire whether our responses have sufficiently addressed your comments. Should any concerns remain, we would be pleased to provide further clarification.

Thank you again for your time and effort in reviewing our work.

Best regards,

Authors

Comments on the paper

2 comments

Dear Reviewers,

Please read the authors' response. Evaluate whether your concerns are addressed or if anything needs more attention. Please engage with the authors while we have time.

Thanks, Your AC

We thank the Area Chair and reviewers for their time and constructive feedback. Below, we summarize our key contributions and the additional analyses conducted in response to the reviews.

Novelty. Existing LLM evaluations primarily focus on what models say and how often different behaviours occur. SCRIPT introduces a measure of where behaviours such as empathy, advice, and questioning appear within responses, in what order, and whether these patterns recur across different users beyond chance. It separates positional structure (C) from behavioural transitions (M), without requiring predefined templates.

Significance. A model may produce high-quality responses while repeatedly following the same behavioural routine across users with different needs. SCRIPT makes these patterns measurable using existing span annotations, complementing quality evaluations and enabling comparisons across models and interventions. Our findings show that response position is more strongly associated with LLM behaviour than measured user context.

Additional evidence. During rebuttal, we conducted more than ten new analyses and robustness checks, including:

  1. Construct validity: Controlled experiments varying preserved behavioural structure, 10,000-permutation significance tests, and comparisons with expert-rated counselling quality.
  2. Contextual adaptation: Tests of behavioural ordering under safety cues, joint analyses controlling for position, user state, and conversation turn, and matched-sample comparisons.
  3. Measurement robustness: Alternative annotation methods, clinician-only analyses, common-event-set estimation of C and M, alternative position units, and sensitivity to behaviour codes.
  4. Interpretability: Analyses of SCRIPT magnitude, behavioural profiles, and the distinction between overall rigidity and specific behavioural patterns.

We also updated our project website with an interactive, step-by-step demonstration of SCRIPT.

Our central contribution is a new evaluation measure to assess whether LLMs repeatedly follow the same behavioural routine across users. We believe SCRIPT provides a useful foundation for future LLM evaluation and behaviour investigation.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.