Comment by ScoutOrgo

Definitely not true. Transfer learning a model trained on a corpus then fine tuned on labeled classes is current SotA approach [1].

[1] http://nlp.fast.ai/category/classification.html