Comment by Lerc

There's a talk by Leland McInnes (on my phone so can't find it rn) where he shows how to make quite effective embeddings through off-the-shelf analytical processes rather than using a large trained model.