halfmoth
Joined 15 years ago
Karma
465
Submissions
38
Member since
Jan 1
Joined 15 years ago
* pre-trained - train on lots of language modelling data (e.g. billions of words of wikipedia) and then train on the task you really care about but starting from the parameters learnt from the language modelling task.