Comment Comment by markasoftware I was able to run 7B on a CPU, inferring several words per second: https://github.com/markasoftware/llama-cpu parent markasoftware 3 years ago
