Comment by mozillas

I ran the 7B Vicuna (ggml-vic7b-q4_0.bin) on a 2017 MacBook Air (8GB RAM) with llama.cpp.

Worked OK for me with the default context size. 2048, like you see in most examples was too slow for my taste.