Comment by mips_avatar

Have you tried any really big models on a mac studio? I'm wondering what latency is like for big qwens if there's enough memory.