You won't be talking to AI in natural language for too long
elicited.blogThis pretty much mirrors my experience so far. LLMs are trained in the semantics of experts, but only experts can actually wield them correctly. It allows us to work with the shapes in our heads (shapes the AI understands now) rather than having to convert them into a collection of things expressible in a programming language (which the AI can now do mechanically).
The next frontier will likely be some kind of AI-first IR that contains high level abstractions you can reshape and reason about with the AI (rather than creating documents - which are lower compression) before it commits to an implementation language.
Thats very interesting view. I actually had some experience with that kind of dense language for specifying when I start testing using two llms to code: one to instruct the coding agent and the agent itself. The instructor start creating quite dense english that sometimes I could not easily understand, but seems to make the coding agent pretty efficient in understanding the requirements.
exactly. to mind-meld with your AI, you will have to use/understand quite dense language.
This doesn't resonate:
Consider this prompt:
Make sure that, whenever a job runs, we can tell where it started from, who triggered it, what settings were passed in, and what changed later. In the future, if something breaks, we want to be able to trace it back and understand what happened.
That is fine.
But an expert can say:
Jobs should persist provenance metadata."
That only works if the model is trained, specifically the way you want, to understand that second sentence. If not, any model could work with the first sentence, but not with the second.
You've crated a need for expert training at the model level (which is insanely expensive to create and maintain) rather than accessible natural language discussions that work on any model and understood by anyone. Denser isn't "better" because the words have more power.
The big models already understand this. I use nomenclature and jargon such as this all the time when using Claude Code on a codebase.
Right, but you still don't know that the big model has exactly the same "jargon" handling as you do. Plus it means that you can't use smaller models not trained on that jargon. That seems like a really limiting black box to place at the heart of a system.
with skills, model can easily learn the jargon.
Would love some critique of my thoughts.