I pushed Qwen3.8-27B to 124 tps on a single request on a RTX 3090

Excerpt

Two days ago I released a hyper-optimized Qwen3.8-27B inference engine for an RTX 3090 (82 tps single request, 672 peak) - yesterday's update took that to 99 tps single-user / ~1,000 tps at 64 concurrent. Since then I've focused on the single-request number, again without quality degradation. It's now ~114 tps at default sampling and ~124 tps greedy (real chat prompts, not random tokens), up from 90 / 98. What we had: - fp8 KV cache, lm_head + embed_tokens int8, fp16 recurrent state, int8 activa