← Back to all articles
Reddit r/LocalLLaMASeptember 2, 2026

Looking for a small LLM for Linux command generation

Excerpt

I'm looking for a small LLM to act as a Linux command assistant. I will use llama.cpp. use case: - User asks in natural language. Model outputs only the shell command - Should work well with no reasoning (for example, LFM 2.6 has forced reasoning) - Fast, like ~4B at most, cause it's going to be on CPU Example 1: "replace string X with Y in file Z" Example 2: "stop and remove docker containers with X in the name" submitted by /u/DunderSunder [link] [comments]