Comment Comment by chudi depends, but you fine tune the whole thing, check ulmfit paper and fastai libs parent chudi 4 years ago
