sh3rl0ck
Joined 1 year ago
Joined 1 year ago
Not too wild an idea!
> This work represents a compelling real-world demonstration of “tiny AI” — highly specialised, minimal-footprint neural networks
FPGAs for Neural Networks have been s thing since before the LLM era.
It's not like Apple is putting any thought into either the UX or the engineering side of utilising the compute properly (except calculating those glass effects extra inefficiently).
Minimise SKUs and get some use out of the binned chips who have a few failed cores.
As you mentioned, scope definition and constraints play a major role but ensuring that you don't just go for the first slop result but refine it pays off. It helps to have a very clear mental model of feature constraints that doesn't fall prey to scope creep.
Kinda like MacOS users only have Aqua, whereas Linux has a lot of DEs, the choice of which is entirely handed to the user.
I find it a little amusing that AI companies provide free AI subscriptions to their employees and their families. Perhaps because I'd never thought of it that way.
That's kinda nice actually; I assume employees get early access to models to test (5.3 codex, for example). Do families get it too?
It's easier than ever to build compatibility for more architectures and devices than ever before, to autonomously test it, and ensure UX rough edges can be rapidly iterated upon across platforms.