Let me preface by saying I despise corpo llm use and slop creation. I hate it.
However, it does seem like it could be an interesting helpful tool if ran locally in the cli. I’ve seen quite a few people doing this. Again, it personally makes me feel like a lazy asshole when I use it, but its not much different from web searching commands every minute (other than that the data used in training it is obtained by pure theft).
Have any of you tried this out?


If by “CLI”", you just mean “terminal”, I’ve used ellama in emacs as a frontend to ollama and llama.cpp. Emacs, can run on a terminal, and that’s how I use it.
If you specifically want “CLI”, I’m sure that there are CLI clients out there. Be almost zero functionality, though.
Usually a local LLM server, what does the actual computation, is a faceless daemon, has clients talk to it over HTTP.
EDIT:
llama-clican run on the commandline for a single command and does the computation itself. It’ll probably have a lot of overhead, though, if you’re running a bunch of queries in a row — the time to load a model is significant.