Show HN: Llama2.c on a Commodore C64
github.comWarning: Inference takes ages.
Pics & Media: https://x.com/VulcanIgnis/status/1893420241310335329 "How this works" - Slowly! I was chatting with ChatGPT 4o the other day and I was asking it on "what steps/software/tools/etc. I need to set up my own LLM offline on a PC". I suggested a few PCs I got, they were all super slow, but for the purpose I want it (numerical analysis) I can make it work. But even my stupid old PCs are times-infinity faster than this C64!! lol :) I once tried to slap TLS/SSL stack onto ZX Spectrum – so HTTPS connection on it worked, but it took solid two minutes to just load a certificate – sometimes you gotta do the "I made a screaming robot - why? - hmmmmmm...." That rules, have you made a writeup of it anywhere? It had to be done :) If not us, who else would? “No? Well, now you can!” Lol, I’m stealin’ that. You can, it's a meme, I stole it from Karpathy :)