Settings

Theme

Show HN: Stargazers Reloaded – LLM-Powered Analyses of Your GitHub Community

20 points by jarulraj 2 years ago · 5 comments · 2 min read


Hey friends!

We have built an app for getting insights about your favorite GitHub community using large language models.

The app uses LLMs to analyze the GitHub profiles of users who have starred the repository, capturing key details like the topics they are interested in. It takes screenshots of the stargazer's GitHub webpage, extracts text using an OCR model, and extracts insights embedded in the extracted text using LLMs.

This app is inspired by the “original” Stargazers app written by Spencer Kimball (CEO of CockroachDB). While the original app exclusively used the GitHub API, this LLM-powered app built using EvaDB additionally extracts insights from unstructured data obtained from the stargazers’ webpages.

Our analysis of the fast-growing GPT4All community showed that the majority of the stargazers are proficient in Python and JavaScript, and 43% of them are interested in Web Development. Web developers love open-source LLMs!

We found that directly using GPT-4 to generate the “golden” table is super expensive — costing $60 to process the information of 1000 stargazers. To maintain accuracy while also reducing cost, we set up an LLM model cascade in a SQL query, running GPT-3.5 before GPT-4, that lowers the cost to $5.5 for analyzing 1000 GitHub stargazers.

We’ve been working on this app for a month now and are excited to open source it today :)

Some useful links:

* Blog Post - https://medium.com/evadb-blog/stargazers-reloaded-llm-powere...

* GitHub Repository - https://github.com/pchunduri6/stargazers-reloaded/

* EvaDB - https://github.com/georgia-tech-db/evadb

Please let us know what you think!

skeptrune 2 years ago

Not quite something I would use, but I think it's a fun project. Good work guys!

  • jarulrajOP 2 years ago

    Thanks for your kind words, @skeptrune! It was certainly a fun project.

    We found some interesting insights. In the Langchain community, ~40% of the stargazers are from India. In the GPT4All community, we found that web developers love open-source LLMs -- more so that machine learning folks :)

    Curious if there is any reason why you would not use it?

treebeard5440 2 years ago

Nice work ya’ll -

lil_sutta 2 years ago

This is amazing! Nice work

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection