Comment by tomp

Better instructions (less verbose and include 30B model): https://til.simonwillison.net/llms/llama-7b-m2

I’m running 13B on MacBook Air M2 quite easily. Will try 30B but probably won’t be able to keep my browser open :/

shameless plug: https://mobile.twitter.com/tomprimozic/status/16348774773100...