Understanding Clustering in Slot Attention via Particle Dynamics

Excerpt

arXiv:2610.04493v1 Announce Type: cross Abstract: Studying attention through the lens of interacting particle dynamics has shown how token clustering can emerge from the underlying dynamics. We extend this perspective to slot attention, a method for object-centric image segmentation and representation learning in which learned components obscure how much of the clustering behaviour is intrinsic to the attention dynamics. We therefore introduce simplified slot attention (SSA), a parameter-free va