The First LLM

You could probably go back even further if you count non-neural large language models. Google made some very very large (300GB+) n-gram language models in the early 2000s.

It wasn't chatgpt, but it was a large model of language.