ru552
Joined 9 years ago
Joined 9 years ago
An easy way (napkin math) to know if you can run a model based on it's parameter size is to consider the parameter size as GB that need to fit in GPU RAM. 35B model needs atleast 35gb of GPU RAM. This is a very simplified way of looking at it and YES, someone is going to say you can offload to CPU, but no one wants to wait 5 seconds for 1 token.
> The policy change is separate and unrelated to Anthropic’s discussions with the Pentagon, according to a source familiar with the matter.
Here's Sundar talking about doing it by 2027: https://www.businessinsider.com/google-project-suncatcher-su...
That's the biggest difference I can tell.
I didn't find any more on that comment below. Is there a list of supported LLMs?
Olive Garden isn't given access to something it requires to operate at the pleasure of the government. Broadcast TV on the other hand...
All of broadcast TV is allowed because the government says it is. ABC/CBS/NBC/FOX don't own the radio spectrum they are operating on, the government does and they grant the right to use it to those companies. There's a long list of things that the government requires them to do in order to keep this pleasure. One of them used to be the Saturday morning cartoons. I miss those.