Comment by dhdhd1

training the GPT-3 175B model required 3.2 million core hours spread across 285,000 processor cores over several months. It is projected that the overall cost of training the model will be roughly $4.6 million.