"How is LLaMa.cpp possible?" great post by
@finbarrtimbersfinbarr.ca/how-is-llama-c… llama.cpp surprised many people (myself included) with how quickly you can run large LLMs on small computers, e.g. 7B runs @ ~16 tok/s on a MacBook. Wait don't you need supercomputers to work