i made an llm from first principles with Jev
29 yes/no questions per character: should the next key be a–z, space, comma, or period?
highest probability gets append to it, then fed the updated text back in & repeat
an autoregressive loop made out of a classifier
After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI?
I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev
• 20-200x faster
• 40-400x