Settings

Theme

An inference server for AMD GPUs, in C++ and HIP

codeberg.org

1 points by this_was_posted · 2 comments

Reader

1 thread
this_was_postedOP

Just posting this here as it helped me get incredible performance out of my 2x r9700 setup that I didn't think were possible when using llama.cpp and vllm

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection