← Back to all articles
Reddit r/LocalLLaMASeptember 10, 2026

New tensor type layouts for my GGUF uploads

Excerpt

Hey all, long time no post. Figured I'd pop my head in to point you towards a blog post I just published about research I had performed and changes I'm making to the shape of models I post, you can read it here: https://huggingface.co/blog/bartowski/per-tensor-layout-maps-for-gguf-quantization I won't try to claim "Pareto frontier" or "best models in the world", but I will say from tests the new shapes look to be better across the board than what I was posting before, so I'm really happy with wh