Settings

Theme

SSE sucks for transporting LLM tokens

zknill.io

6 points by zknill 16 days ago · 1 comment

Reader

verdverm 16 days ago

interesting, I've put pub/sub into my custom agent setup (for other reasons) (also have the websockets, rest, and SSE...)

but yeah, it definitely helps with this issue, so agents can keep doing work with no clients attached, and can share their progress when they do connect, but not at the point OP is talking about, which would be a nice addition!

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection