Settings

Theme

SSE sucks for transporting LLM tokens

zknill.io

6 points by zknill 2 months ago · 1 comment

Reader

verdverm 2 months ago

interesting, I've put pub/sub into my custom agent setup (for other reasons) (also have the websockets, rest, and SSE...)

but yeah, it definitely helps with this issue, so agents can keep doing work with no clients attached, and can share their progress when they do connect, but not at the point OP is talking about, which would be a nice addition!

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection