Written as a Record, Read as an Address: What a Forward Pass Leaves in an Operation's KV Cache

Excerpt

arXiv:2609.24635v1 Announce Type: new Abstract: When a language model reads an operation such as "Swap the contents of Box F and Box B", its forward pass writes keys and values for those tokens into the KV cache. Prior work on entity tracking establishes what models use: bindings are resolved at query time rather than stored as explicit latent state. We ask what they write at the operation span and how it is accessed. We split a forward pass into a frozen writer and a reader: the writer's cache