Comment by chanchar

It's always going to be about time and money. With more GPUs, it'll take less time to train. You're also not locked into a cloud provider like AWS or GCE if you plan to do this long term.