Reddit r/LocalLLaMASeptember 11, 2026
Someone apparently managed to kind of replicate what V4.1 flash does on KV for fast prefill on Qwen
Excerpt
I wonder someone will figure out a way to do this with 27B? Throw Qwen3 on this page for demo https://kishida.github.io/webdemos/llkvapprox/ Edit: sources (thank you u/pmttyji for finding them! Blog Post : https://nowokay.hatenablog.com/entry/2026/09/11/120001 HuggingFace : https://huggingface.co/kishida/Q3-8B-KVA-Projector/tree/main GitHub : https://github.com/kishida/webdemos submitted by /u/T_rex2700 [link] [comments]