KVEraser: Learning to Steer KV Cache for Efficient Localized Context Erasing

Excerpt

arXiv:2606.17034v3 Announce Type: replace-cross Abstract: Post-hoc context erasing over the KV cache is challenging because a local edit has a global consequence: once a span has been processed, its influence propagates into the cached states of all subsequent tokens. This issue arises naturally in long-context LLM applications, where stale, incorrect, or harmful context may be identified only after prefill. Exact erasing must then recompute all tokens after the deleted span, making its computat