Here my pretty good qwen3.8 27B setup, hope it helps

Excerpt

Since I spent the time to figure it out and it is not like it will make me any money ever. I think I'd share with you all what I managed to cobble together. First and foremost here the relevant bits about my hardware and software stack: OS: Debian 13 CPU: 8700G GPU: 7900XTX (this GPU has 24GB VRAM as all the others of its kind) I definitively have system ram but this configuration does not touch it very much so I won't go over that. A bit of history, I tried something alike with the previous Qwe