Comment Comment by Retro_Dev > 80+ tok/sec on the smallers models.how does this compare against existing TPUs? Also, how small is "smallers models?" parent Retro_Dev 25 days ago
how does this compare against existing TPUs? Also, how small is "smallers models?"