am17an
Joined 10 years ago
Karma
212
Submissions
89
Member since
Sep 4
https://github.com/am17an
View on Hacker NewsJoined 10 years ago
> The cool thing is that training on diverse datasets improves scores on other downstream tasks, while the training objective is the same.
Maybe for some language modelling tasks, i.e. it learns some internal representation that is transferable. However I would find it quite odd if a model becomes good at Bio while not explicitly going through Bio training.
EDIT: just re-read your comment. I don't think you have a good understanding here, no offence.
They are explicitly trained for each task individually.
[^1] https://www.nist.gov/news-events/news/2026/05/caisi-evaluati...