yes, there are billions of parameters necessary. but large language models only came out about 5 years ago. I'm confident 5 years from now the parameters necessary to get gpt-4 performance will be decreased orders of magnitude.
at the very least, even if that's not the case, inference will be drastically less gpu heavy by then I suspect.
at the very least, even if that's not the case, inference will be drastically less gpu heavy by then I suspect.