Comment by wolttam

Are you sure about that? High memory speed is great for dense models, or when serving at high concurrency.

However for local single-user setups, it's often better to have access to more capable/bigger MoE models at reasonable speeds and lower concurrences, which is enabled by these platforms.