Comment by Hendrikto

Afaik, TPUs are only used for inference, not training. Maybe that was also what the quote referred to.