Comment Comment by arnaudsm It's linear for now (check GPT-2 vs GPT-3), but we're close to the point of diminishing returns. parent arnaudsm 4 years ago