ENGNR
Joined 13 years ago
Joined 13 years ago
I’ve heard a quantised version of flash next can fit in ~50 gb of vram (which needs a system level flag set to go over 48gb)
But the m1 cpu is itself a bottleneck on prefill compared to say an m5, there’s no real getting around it. And the 400mb/s bandwidth starts to hurt without MOE
Hoping these model optimisations can see us through to 2028 because for everything other than LLMs this hardware is still over specced and working incredibly well
Share tax changes... ugh
My hope was cashed up bogans would start betting on shares instead of housing/crypto. At least it could be funnelled into something productive
Instead of two certainties in life being death and taxes, it's now death or taxes.
If you're bootstrapped, borrow a bunch of money to pay tax because your company got to $10M val. But then the market shifts and it goes back down to $0 in later years, do you get the money back?
Even if you do, it sounds weird taxing someone for the right to create something, especially when they're still in the middle of creating it.