For self-learning LLMs, governance needs to improve

Hey HN!

Been experimenting with self-learning (And if you don't like me calling it self-learning, mentally replace it with doing the raspberry) LLMs, and the biggest takeaway I've taken?

Things like governance, observability, and auditability are pretty poor right now. This is just my take on how to improve things.

Also, and surprisingly? The most valuable thing I've seen with my experimentation is failures. Not success. Failures generalize, successes don't. A large amount of tasks can get generalized information for failures, but only specific tasks can get information from successes.

Project is open source, no paid SAAS, not commercially viable. I'm just an excited hobbyist with absolutely no business sense whatsoever.