This is very interesting, i was building something similar, but i used https://github.com/K0IN/string-embed (embeddings based on a distance function - Levenshtein in my case) to generate embeddings, for deterministic matching.
I will follow your project, im interested in your ann search speeds :)
I will follow your project, im interested in your ann search speeds :)