Caveman Mode Save Token?
twitter.comOnly two or three weeks from incepting the idea of a token efficient LLM English dialect to seeing it in practice. I just never imagined it to take.... this particular form.....
I've had the thought that English is an efficiency barrier for a while now. Surely there are more information-dense representations of semantic concepts.
Some languages for example have single characters that represent entire ideas/phrases.
https://en.wikipedia.org/wiki/Le_Taureau
"Everything should be made simple as possible but not simpler"
I used a system prompt similar to this, where I just dumped the entirety of https://grugbrain.dev/ into it and prefaced it with the assistant having to emulate grug.
Didn't find it particularly useful, but is is funny!
Can this actually work?
It does. I've been tinkering with Copilot Studio Agents and you can hit a 8k character limit quickly. By taking your instructions and asking Copilot to compress the information down, while ensuring they are still human readable, you can cut it back to about 5k characters. The information is more dense and functionally the same and the agent is just as consistent as before.
Anything that reduce input/output works to an extent logically.