Settings

Theme

Q8 KV cache lets a 30B model fit 100K context on a 24 GB RTX 5090

buraak.com

3 points by bozdemir 2 months ago · 0 comments

Reader

No comments yet.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection