How I got Qwen 3.8 27b running at ~75t/s decode on 16GB RTX 5080

Excerpt

Hi all, I have recently been experimenting with different LLM set ups and after everyone was raving about how good Qwen 3.8 27b was, I was inspired to try and get it deploying. After some battling with settings I've managed to get it running at an average of 75t/s, sometimes seeing 100+t/s with good MTP acceptance. I've managed to do this using: Qwen3.8-27B-i1-IQ4_XS-GGUF-Smaller - jrell/Qwen3.8-27B-i1-IQ4_XS-GGUF-Smaller · Hugging Face "A custom hybrid quantization of the Qwen3.8-27B base model