Comment

Comment by namjh

Given the rumored numbers are all true, this could be a huge contender to M5 Ultra(or M7 Ultra if we consider possible delays in the schedule?). Low-batch single-user serving is usually bottlenecked by `E(sum over (memory bandwidth by tier) * (memory size by tier))`.

edit: typo

parent namjh 19 days ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton