eldenring
Joined 4 years ago
Joined 4 years ago
This is probably the single most important thing to make frontier models usable right now, so I'm happy there seems to be some progress. This was the previous Gemini's biggest problem IMO
> Indeed, the algorithm requires you to multiply complex numbers whose magnitudes grow superpolynomially with n. If you stored these numbers as bits, the memory requirement would effectively be exponential in the input length. It assumes you can multiply such arbitrarily large complex numbers together in a single operation.
Another way to think about what the author said, imagine you had access to an oracle which could execute arbitrary precision arithmetic expressions in constant time. You could encode a wide range of computations in these and execute impossible algorithms.
As a side note, I don't understand why I keep seeing these wrong arguments on HN repeatedly. Like everything mentioned in this thread can easily be fact checked. Radiative cooling is solved, launch costs are going down, so power costs will pay themselves back very quickly, etc.
You can argue about specifics, like chips will get more sophisticated + power efficient and fabrication will be the true longterm bottleneck, or SMRs/fusion could reduce energy bottlenecks, but talking about cooling as if convective cooling is the only option is just nonsensical.
> this is just not true at all, there are massive leaps from algorithms, data, etc. every year. scale is one axis of many and you need to get them all correct.
this view isn't updated correctly post-claude code and codex. there will clearly be sufficient demand.
An example here is in engineering. Building a simulator for some process makes computing it much safer and consistent vs. having people redo the calculations themselves, even with AI assistance.