Visualizing LLM embeddings on a sphere

Vibe-coded weekend project to visualize the 1536 OpenAI embeddings on a smaller plane to see how different domains get modeled and grouped

Pretty fascinating to see (1) how well it clusters topics you'd expect to cluster (e.g., you can see the color density), (2) how some topics overlap across domains

Works by running across the dataset of words to get the embeddings, then PCA then UMAP to get to the 2D plane. From there React / Three Fiber are used to create the visualization.

Live version available here also: https://nofone.io/experiment/3dembed/