Let the Heads Talk: Beyond Diagonal Graph Attention

Excerpt

arXiv:2610.01494v1 Announce Type: new Abstract: Sheaf Neural Networks generalize scalar-weighted message passing by replacing scalar edge weights with linear transport maps between local feature spaces. Yet the role of this matrix-valued transport is entangled with the broader sheaf-diffusion construction. We isolate the transport primitive through quiver representations and establish a direct connection with multi-head attention. Treating attention heads as coordinates of a local transport spac