Settings

Theme

Improving Throughput by Optimising KV Cache Efficiency for Agentic Workloads

j9s.io

3 points by kkm · 1 comment

Reader

1 thread
taintech

I really like this article, agent harness knows its own state: which tool call is running, whether a sub-agent is pending, when it is finished. The API throws that away because each request looks stateless. Interesting idea.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection