Comment Comment by p1esk Replicating GPT-4 pre-training with current hardware would cost about 40-50m in compute.Source? My educated guess it’s somewhere between 10 to 100 times cheaper than that. parent p1esk 3 years ago
Source? My educated guess it’s somewhere between 10 to 100 times cheaper than that.