Settings

Theme

Llama Deck:CLI for running multiple language implementations of LLM inference

github.com

1 points by mikepapadim a year ago · 1 comment

Reader

mikepapadimOP a year ago

Llama Deck is a command-line tool for quickly managing and experimenting with multiple versions of llama inference implementations. It can help you quickly filter and download different llama implementations and llama2-like transformer-based LLM models. We also provide some Docker images based on some implementations, which can be easily deploy and run through our tool.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection