The Functional Structure of Post-Compression Recovery in Low-Rank LLMs

Excerpt

arXiv:2610.05504v1 Announce Type: new Abstract: Different low-rank compression methods can produce compressed LLMs that respond differently to the same post-compression recovery procedure, and relative advantages observed between methods at the compression endpoint may shrink, grow, or even reverse after recovery. We ask whether this recovery heterogeneity reflects functional structure beyond scalar loss evolution, and how that structure evolves throughout recovery. Our results establish that th