Comment Comment by Palmik > For example, training and serving Llama 3.1 on Google TPUs is about 30% cheaper than NVIDIA GPUsWhen you say this, you should specify which Nvidia GPU you mean (I assume h100 SXM) and that price you are assuming for such GPU.One can't simply compare based on the on demand price on GCP, because the Nvidia GPUs there are extremely overpriced. parent Palmik 2 years ago
When you say this, you should specify which Nvidia GPU you mean (I assume h100 SXM) and that price you are assuming for such GPU.
One can't simply compare based on the on demand price on GCP, because the Nvidia GPUs there are extremely overpriced.