10c8
Joined 3 years ago
Karma
22
Submissions
10
Member since
May 24
Joined 3 years ago
all-MiniLM-L6-v2 is a really (if not the most) popular one (albeit not SotA), with 384 dimensions: https://huggingface.co/sentence-transformers/all-MiniLM-L6-v...
Edit: A more modern and robust suite of models comes from Nomic, and can generate embeddings with 64 to 768 dimensions (https://huggingface.co/nomic-ai/nomic-embed-text-v1.5).
When the author talks about thousands of dimensions, they're probably talking about the OpenAI embedding models.
- "[...] Certainly here is a vast and important project for research."
Versus:
- "Certainly! Here is the text with spaces added after each word:"
Just joined the waitlist, excited to try it out!