The LLMs Problems
What problems are you all facing while building with LLMs?
The core problems with my agentic swarm, although I I have found ways to mitigate some it. 1. Falling into the yes bot role, everything seems like a major win, and 6 hours later it was almost always a guaranteed loss. For example it turns out this bounty was in fact real, but the math is impossible at this level. Unless can solve 10 to power of 78, we should have never even made it past step 1. I have coded a kickback feature for my cli agent to assess harder if it has agreed with everything in 8 or more responses.
Fairly basic but on larger builds I find the file/folder naming can get vague and confusing. Even the structure at times, like why did you just put final reports in the root folder when we just made Documents/Reports/Final.
Token usage to me has shifted for me. Previously I could get by Gemini cli free tier with more than one gmail. Now I may burn 4 accounts in one day, gotta love google.
Honestly, at this point my biggest problem is coming up with more ideas of what to build next. I know that's probably not the type of answer you're looking for but, it's the toughest part for me lately.
There are a lot of ideas on user-script sites with regards to what people are changing on their preferred destinations using client-side scripting. I mentioned that in my previous comment.