Comment by hijodelsol

I would think that for training Google has optimized their entire setup for TPUs so I can’t see how this would be used for anything but inference