Comment Comment by tarruda You can run at ~20 tokens/second on a 512GB Mac Studio M3 Ultra: https://youtu.be/ufXZI6aqOU8?si=YGowQ3cSzHDpgv4z&t=197IIRC the 512GB mac studio is about $10k parent tarruda 11 months ago
IIRC the 512GB mac studio is about $10k