How I got 280 tok/s on Qwen3.8 27B on 2xr9700's and 940k tokens kv cache

Excerpt

2 Months ago I had made a post how I was working on my dual R9700's. It's wild to look back at where we were then and where things now stand. Since then after many users commenting and complaining about developers doing the same thing. I threw out a discord link and expected maybe 5 other developers to join which I thought would be fun. The community has now grown to 1,200 users (mostly developers) and a ton of collaboration happening. A few weeks ago I started working on building support for MX