acceptodds
Under review as a conference paper at ICLR 2027

Temporal Concepts and their Shape in Large Language Models

Abstract

Large Language Models (LLMs) are increasingly being deployed to make decisions that require trading off near-term gains against long-term consequences, yet little is known about how they represent these tradeoffs internally. We localize temporal concepts to their fractional depth, across families (Qwen, Llama, Gemma, Mistral), scales (Qwen 0.6B to 14B), and domains (financial, health, climate, education, entrepreneurial). Around those fractional depths, time horizon forms an ordinal gradient. These concepts undergo complex transformations across token positions. We measure temporal preference stability and temporal reasoning coherence. Every model shows temporal structure, but the representational manifold is not always functional, as it does not imply good intertemporal behavior. Our work advocates for greater oversight of LLM temporal behavior.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.