Comment by theCrowing

It seems like you have no real knowledge about what you are talking. If the last years told us anything especially with the bad performance of GPT-J and BLOOM we will see these models ballooning for at least 2-3 more years on the hardware side there is also nothing that shows that the costs will go down.