Llama.cpp with CUDA Support on Original Jetson Nano (4GB)
github.comOriginal title: Llama.cpp with CUDA support on a Jetson Nano
Editorialization: Added 'Original' and (4GB) to highlight that this project adds support to the long abandoned Nvidia Jetson Nano.
Nice work, the benchmarks don't look terrible for what it is, especially the prompt processing.