Show HN: Using DSPy to enrich a dataset of the Nobel laureate network

8 points by laminarflow027 5 months ago · 0 comments · 1 min read

I've been working a fair bit with DSPy lately, and I did some work in combining the benefits of vector search and LLMs (via a DSPy pipeline) to disambiguate records with a high degree of accuracy to help enrich a dataset. The blog post shows how this approach scales well, is very cost-effective and super concise - all it takes is < 100 lines of DSPy code and it all runs async.

The code to reproduce is in this repo if anyone's interested (all tools are 100% free and open source, and the methodology will work with open weight LLMs too). https://github.com/kuzudb/dspy-kuzu-demo

No comments yet.