Settings

Theme

Running Hugging Face GGUF Models Locally with Ollama [video]

youtube.com

3 points by jexp 2 years ago · 1 comment

Reader

jexpOP 2 years ago

Quick 5 minute video on downloading and running Hugging Face language models in GGUF format (quantized by TheBloke) with Ollama on your local machine and checking GPU consumption with asitop (Apple Silicon Mac Top).

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection