Idea: massively compress Qwen 3.8 KV cache by using a single bit for the token "wait"

Excerpt

Not even sure if I'm joking, my thinking history is about 50% "wait". submitted by /u/pixelpoet_nz [link] [comments]