Ask HN: Best cheap decent LLM for handling code, social media profiles?

3 points by throwawayadvsec 2 years ago · 4 comments · 1 min read

Hi, I'm looking for a LLM that can be used to have decent answers to stuff like: "what libraries do this code import?" "does this code follow this design pattern?" "do the variables used in this code have a meaningful name?"

GPT 3.5 turbo can do it pretty well, but it's out of my budget, as I would need to make a LOT of requests.

I have about 8,000$ in AWS credits for self hosting

Is there any LLM you'd recommend for this?

I was thinking of reverse engineering copilot and using its internal API directly, do you know if there is a big rate limit?

thanks