Hi folks, I’ve been working on llmpm, a CLI tool that makes open-source LLMs installable like packages.
The idea came from the frustration of trying to run different models locally. Every model tends to have slightly different instructions, dependencies, or runtimes. I wanted something that worked more like npm or pip, install a model and run it immediately.
With llmpm you can do things like:
llmpm install llama3
llmpm run llama3