Temporal Preference Concepts and their Functions in a Large Language Model
Large Language Models (LLMs) are increasingly being deployed to make decisions that require trading off near-term gains against long-term consequences, yet little is known about how they internally represent or resolve these tradeoffs. In this work, we causally localize an underlying subgraph for temporal preference in a distilled LLM (Qwen3-4B-Instruct-2507), identifying mid-to-upper-layer nodes through converging evidence from gradient-based attribution and activation patching. We find that the geometry of time horizon is encoded in the residual stream at the expected localized layers. A behavioral analysis reveals that unintervened LLMs discount the future several times less steeply th...
| Authors | Ian Rios-Sialer, Shantanu Darveshi, Shuai Jiang et al. |
|---|---|
| Primary category | cs.LG |
| Published | 11 May 2026 |
| Last updated at source | 8 July 2026 |
Connected in the knowledge graph
- anicola/ptm-relevance-aware-decoder-qwen3-14bDataset · cited by
- CodeReclaimers/spar-planning-temporal-manifolds-activationsDataset · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.