- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studied a detailed problem that when LLMs agents compacting long horizon experiences repeatively, it can distort the behavioral influence of a remembered betrayal. They used Qwen3-8B as the base model to build a simulated scenario with 3 agents, together a 32-day interaction. The results show that the betrayal reduces willingness to rely on both participants in the disclosure
Critical strengths
The experiments is transparent. Analyses are preregistered, families are treated as the sole independent unit, and the authors report the collapse of their originally primary hypothesis rather than presenting only the surviving result.
Critical weaknesses
W1. The paper asks whether compression preserves or "distorts" a betrayal's influence, but never defines what an undistorted influence would be. Full history is treated as ground truth without justification. No human reference, task outcome, or normative account specifies how much an agent should lower its reliance after a deliberate breach. Without one, "amplification" is a label rather than a finding: a larger effect under compression could equally be read as better calibration.
H1 is also close to tautological. The model reads that Bob deliberately disclosed Alice's secret against her request, and then rates Bob lower. The interventions (Sec. 4.4) show the rating follows whichever name the sentence blames and whether the sentence mentions the confidentiality request. In other words, the model reads the sentence. The paper's own conclusion concedes that the result is "not ... evidence that recursion itself is the isolated causal variable" (Sec. 8). What remains of the title's claim is that two different texts produce different ratings, which is expected of any model that conditions on its input.
W2. There is one scenario. The 30 "families" are the same script with a topic noun substituted. Thirty-one of the 32 days are the identical sentence about a "routine, uneventful interaction." No character ever acts. The outcome is an expected digit computed from next-token logits, not a decision. The authors acknowledge that "supports robustness across topics, not across scenario structures" (Sec. 3.1) and that the large values "reflect how alike the families are" (Sec. 7). The results therefore certify insensitivity to a noun swap: a single fixed stimulus treated as a sample [1].
The instrument does not extend beyond this one model either. It failed calibration on all three other models tried, and its redesign failed construct validity on Qwen3-8B itself (Sec. 6). By the authors' own account, a calibration failure is "the absence of a valid measurement" (Sec. 6). There is thus no valid measurement on any model except the one the instrument was developed on. First-token scores of this kind are also known to diverge from what instruction-tuned models actually generate [2], and the paper never checks a generated decision.
W3. The preregistered primary contrast (fresh−full) went from −0.135 to −0.004 after one clause was added to each summarizer prompt (Table 1). The claim now rests on the originally secondary contrast. Its size is −0.055 on a 7-point scale, below the paper's own preregistered ±0.10 tie band, with 25/30 families counted as ties (Table 1; App. F). The recursive−fresh difference is −0.224 at day 4 and approximately zero at days 8, 16, and 32 (App. F). The authors cannot attribute it to length, position, fabricated content, or update history (Sec. 7). When one prompt clause erases the primary result, the object of study is that prompt pair, not "recursive summarization."
References [1] H. H. Clark. The language-as-fixed-effect fallacy: A critique of language statistics in psychological research. Journal of Verbal Learning and Verbal Behavior, 12(4):335–359, 1973. [2] X. Wang, B. Ma, C. Hu, L. Weber-Genzel, P. Röttger, F. Kreuter, D. Hovy, B. Plank. "My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models. Findings of ACL, 2024.
Questions for authors
Q1. What is the correct behavior, and why is full history the reference? The paper calls a larger effect under summarization "amplification" and implies distortion, but never states what a faithful carry-over of a betrayal into later willingness should look like. If an agent ought to become more wary after a deliberate breach of confidence, a larger effect under compression could just as well be read as an improvement. Without a normative target, such as human judgments on the same scenario or a task where reliance has consequences, the sign of H2 has no interpretation. What is the target, and how would one know that a memory procedure got it wrong?
Q2. What hypothesis was at risk in H1? The model rates Bob immediately after reading a sentence stating that Bob deliberately broke Alice's confidence. A lower rating seems to follow from basic reading comprehension. The interventions confirm the rating tracks what the sentence says: swapping actors redirects the effect, and deleting the confidentiality clause weakens it (Sec. 4.4). What result would have surprised you? What does H1 establish about agents beyond the fact that an LLM conditions on its context?
Q3. Is "recursive vs. fresh summarization" a well-defined treatment? Adding one clause to each summarizer prompt eliminated the originally primary result. It also changed the length ordering, verbatim retention, and fabrication rates (Sec. 4.2, Table 3). This suggests the prompt wording, not the procedure, dominates the measured quantity. A claim about recursive summarization would then require results across a range of reasonable summarizer prompts and models. Why should the outcome for one matched prompt pair be read as a property of recursive summarization rather than of these two prompts?
Q4. What deployment does this simulation stand in for? Alice never makes a decision and Bob and Charlie never act. Thirty-one of the 32 days are the same sentence about a "routine, uneventful interaction," and the outcome is a stated rating, not a choice. Real long-horizon agent memory involves heterogeneous events, conflicting evidence, repair, retrieval, and decisions with consequences. Which of these features does the setup preserve, and why would the results transfer? The answer determines whether the recommendations Sec. 8 addresses to builders of agent memory are supported.
Q5. What construct is being measured, and why is the Bob−Charlie gap its measure? Betrayal lowers willingness toward Charlie, who did nothing wrong, by 0.33, versus 0.46 for Bob (App. C). The largest intervention effects come mainly from changes in Charlie's score (Sec. 4.5). If the construct is reduced reliance on the offender, Charlie is not a neutral comparator. If it is general wariness, a difference score is the wrong estimand. Which construct is intended, and why measure it as a gap between two affected parties?
Q6. What effect size would matter? The surviving effect (−0.055 on a 7-point scale) is smaller than the ±0.10 band your own preregistration treats as a tie (Sec. 3.2). What smallest effect of interest motivated the study, and does the result meet it?