CORTEXA
← Browse
arxivcs.CLcs.LG2026-07-11

One mechanism for many mental spaces: a shared router over a value slot in language models

Oliver Steele, Jiangtao Wen, Yuxing Han

Language builds discourse contexts other than the actual: a painting, a belief, a memory, a hypothetical. Each is a mental space in which the same entity can take a different value, as when a flower is red in reality but purple in a portrait. Formal semantics keeps these contexts apart because their logics differ (modal, temporal, doxastic, depictive). Fauconnier's mental-space theory, by contrast, treats them as one space-building operation. We ask which of these a transformer language model implements, and find a mechanistic version of Fauconnier's unification. The model uses one router/slot format across the inventory: a reusable value slot stores attributed content, and a causally manipulable router (the space index) selects which space is read. A subspace trained with Distributed Alignment Search to control one space type, counterfactual, belief, fictional, or temporal, also controls the others, well above a random floor, on three model families. Belief, which formal semantics marks as a distinct case, is not specially separated. The router is low-rank, composes additively with entity identity, and acts through a few late-layer heads. Two further results show the mechanism drives inference and composes: a subspace trained on a rule-derived conclusion flips what the model infers while dissociating from what it reports, and composing space-builders mints a fresh router over the shared slot. This paper establishes the cross-type generality. A companion paper develops belief in depth, because of its special status in philosophy, psychology, and linguistics (epistemology, theory of mind, and propositional attitude reports).

View free PDFSource page

Related papers

arxivcs.CLcs.LG2026-07-11

Belief-reality separation lives in routing over a shared value slot in language models

Oliver Steele, Jiangtao Wen, Yuxing Han

Capable language models hold what a character believes apart from what is true: told "Anna believes the cup is blue; in reality it is red," they answer blue about Anna and red about the world. Where in the computation does that separation live? We show it rests on two separable m…

View free PDFSource page
arxivcs.LGcs.AIcs.CLcs.DB2026-07-22

Auto-Fill: Learning to Predict Missing Values Accurately with Specialist Language Models

Yurong Liu, Yeye He, Haoyu Dong, Junjie Xing, Shi Han, Dongmei Zhang, et al.

Predicting missing cell values in tabular data is a fundamental problem in data cleaning. While state-of-the-art reasoning models show great promise in predicting missing values in tables, by reasoning holistically across rows and columns, they are costly to deploy at scale and t…

View free PDFSource page
arxivcs.LGcs.CEcs.CLq-bio.BM2026-07-14

Learning Mechanistic Reasoning for Chemical Reactions with Large Language Models

Xingyu Dang, Haocheng Tang, Junmei Wang, Yanjun Li

Reaction mechanisms consist of the step-by-step sequences of elementary reactions that explain chemical transformations. Learning the mechanism logic is therefore essential for enhancing the fundamental chemical intelligence of large language models (LLMs). The stepwise deduction…

View free PDFSource page
arxivcs.AIcs.CLcs.LGcs.MA2026-07-11

Ontology-Amplified Distillation and Contextuality Auditing for Sovereign Enterprise Language Models: A Combined Proof-of-Mechanism and Negative-Results Method Study

Thanh Luong Tuan

Regulated financial institutions operating under data-residency rules need tenant-owned language models that can run inside the institution's perimeter. This paper combines two related FAOS studies into one mechanism-and-control article. First, it reports a reduced-power proof-of…

View free PDFSource page