syrrim
Joined 11 years ago
Joined 11 years ago
does this mean they were ordered to take them down by the government? what can they do in that case?
No, major cloud providers are mainly a software business. They provide unique manage cloud offerings, which provides value add over raw hardware as well as lock in. People on AWS cannot just move to GCP, let alone DO. Hence amazon can charge a substantial premium over the price of the hardware, which is why they make so much money. If all you are doing is plugging in GPUs, you don't provide that value add and are going to have very slim profits.
Then bad news: LLMs already use randomness in a fundamental way. Each time they go to generate a token, they first generate a probability distribution of possible tokens. Then they pick one randomly according to this distribution. The technique described can be thought of as making the random number generator pseudo random. The output it generates is one of the possible outputs it would have generated before, just now it's deterministic and will generate the same thing every time.