Latest AI/ML News
770 articles · Reddit r/LocalLLaMA
Astra's launch has produced a strange discourse. The reporting that broke the story framed the model's use of recurrent depth primarily as a safety re…
Hello Guys, Just sharing this harness I've created, this runs entirely on chromium based browser. No installation is required, it has its limitations…
Planning to build a PC mainly for local LLMs/coding agents. I keep seeing 3090 + Qwen 3.8 Flash Next benchmarks, but could not find enough info for th…
submitted by /u/TGSCrust [link] [comments]
Hi! I've been following this community for quite a while and have difficulty figuring out what to put on my 3080 12gb - I know Qwen 3.6 35B 3A was the…
Nice pp improvements for RDNA4(R9700) & 3.5(RX 9060 XT, 8060S). More good numbers on large context. PR has detailed benchmarks. u/ilintar 👍 submitted…
A few years ago a 100GB was considered a very large language model. What do we call under 100GB models now? Tiny models? haha submitted by /u/Terminat…
submitted by /u/jinnyjuice [link] [comments]
Surprised no one has posted it in this sub. Pretty solid model, IMHO. Demo: https://map-yue2.github.io/ submitted by /u/Acceptable-Cycle4645 [link] [c…
I haven't seen this mentioned yet, so I thought it deserves a post. I was trying out OpenWhispr when this model came up as the recommendation. So I do…
Some people says terminal bench reflects model intelligence better than the intelligent index. From the look of it, the ranking does seem to reflect h…
I wonder someone will figure out a way to do this with 27B? Throw Qwen3 on this page for demo https://kishida.github.io/webdemos/llkvapprox/ Edit: sou…
I made this because I was getting genuinely annoyed at trying to have a normal conversation with LLMs. Even with prompting and various tricks, most mo…
https://huggingface.co/security.txt submitted by /u/Nunki08 [link] [comments]
https://preview.redd.it/3z56sdq1yqoh1.png?width=1362&format=png&auto=webp&s=5c9848a396a4bd2ec472a6b4761f90263feb44cc It's on par with 5.6 sol but for…
submitted by /u/backyard_tractorbeam [link] [comments]
Both good and bad things have come from a subreddit that was lot more niche than for example r/flashlight rapidly transforming into the largest online…
Hey all, long time no post. Figured I'd pop my head in to point you towards a blog post I just published about research I had performed and changes I'…
The downside of uncensoring a model is that it is known to potentially damage it, but CyberTiel is an even more capable software engineer than its cen…
Furthermore, the weight of their private tests in the overall assessment is increasing. submitted by /u/Altruistic_Plate1090 [link] [comments]