Nice work. It makes me think: is it really impossible to use the model2vec framework with this? It can be used to turn an embedding model into a super fast cpu only vectorizer. I think it loses the order of words but, someone's gotta try and see if it works anyway right?
https://github.com/MinishLab/model2vec