Attention Flows: Tracing LLM Conceptual Engagement via Story Summaries

Excerpt

arXiv:2604.06416v2 Announce Type: replace Abstract: Although LLM context lengths have grown, there is evidence that their ability to integrate information across long-form texts has not kept pace. We evaluate one such understanding task: generating summaries of novels. When human authors of summaries compress a story, they reveal what they consider narratively important. Therefore, by comparing human and LLM-authored summaries, we can assess whether models mirror human patterns of conceptual eng