Settings

Theme

Understand and train your own GPT – No prior AI or coding knowledge

colab.research.google.com

4 points by serced 2 years ago · 1 comment

Reader

sercedOP 2 years ago

Hi all I wrote this "blog" Google colab notebook for friends and family who have little technical know-how or do not yet have an understanding of language models. It's based on nanoGPT (a minimal GPT implementation from Andrej Karpathy, ex-OpenAI - not sure whether there is a need to state this here). However, I rewrote the code from scratch, made it more explicit, and have lots of textual information such that everyone should be able to follow what is happening when, and train their own little GPT :) Hope it helps some people and let me know if you have any questions/feedback.

Tl;dr: Blog about how LLMs work & train a mini model without prior knowledge.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection