Vibe-coded weekend project to visualize the 1536 OpenAI embeddings on a smaller plane to see how different domains get modeled and grouped
Pretty fascinating to see (1) how well it clusters topics you'd expect to cluster (e.g., you can see the color density), (2) how some topics overlap across domains
Works by running across the dataset of words to get the embeddings, then PCA then UMAP to get to the 2D plane. From there React / Three Fiber are used to create the visualization.
Pretty fascinating to see (1) how well it clusters topics you'd expect to cluster (e.g., you can see the color density), (2) how some topics overlap across domains
Works by running across the dataset of words to get the embeddings, then PCA then UMAP to get to the 2D plane. From there React / Three Fiber are used to create the visualization.
Live version available here also: https://nofone.io/experiment/3dembed/