Ornith-1.5-35B-A3B-NInfer - 250 tok/s, 5-8k prefill, 5090

Excerpt

I tried this model yesterday, and it felt to me like the best one I've tried for a local model for interactive use; the responses and reasoning are very fast, and it actually performs agentic tasks well. The speed is phenomenal. I am running this on Ninfer for Windows - https://github.com/natpate/ninfer-windows submitted by /u/koloved [link] [comments]