The focus on TOPS seems a bit out of line with reality for LLMs. TOPs doesn't matter for LLMs if your memory bandwidth can't keep up. Since it doesn't have quad channel memory mentioned I guess it's still dual channel?
Even top of the line DDR5 is around 128GB/s vs a M1 at 400GB/s.
At the end of the day, it still seems like AI in consumer chips is chasing a buzzword, what is the killer feature?
On mobile there are image processing benefits and voice to text, translation... but on desktop those are no where near common use cases.
Even top of the line DDR5 is around 128GB/s vs a M1 at 400GB/s.
At the end of the day, it still seems like AI in consumer chips is chasing a buzzword, what is the killer feature?
On mobile there are image processing benefits and voice to text, translation... but on desktop those are no where near common use cases.