$\alpha$Transfer: Coefficient Transfer for Efficient Model Merging

Excerpt

arXiv:2610.07819v1 Announce Type: new Abstract: Model merging offers a promising solution for combining multiple fine-tuned checkpoints into a single model through parameter arithmetic. However, finding optimal merging coefficients requires an extensive search that becomes prohibitively expensive as models scale in both size and number, due to high memory requirements and combinatorial growth in the search space. We show that, within the same model family, models exhibit highly congruent perform