Experience report - Qwen 3.8 Flash Next on memory rich, GPU poor setup

Excerpt

(not written by Claude, all errors and crappy text are result of too little coffee on a Sunday morning ;) Our home server is a 2018 Thinkstation P520, bought for about 600eur in 2023. It's been upgraded with a 2TB Samsung 980 Pro NVMe, a Xeon W-2145 and a 12GB 3060 - total cost about ~1k all in. Not nothing, but not a crazy amount of cash for all the capability it provides. 256GB ECC DDR4 at 2666mhz, quad channel at about 80GB/s. Qwen 3.6 35b a3b Q4_K_M was the daily driver, on builds of llama.c