Settings

Theme

Stop using JSON for LLM structured output

nehmeailabs.com

2 points by 44za12 · 1 comment

Reader

1 thread
44za12OP

For simple extraction tasks, a delimiter-separated string uses 11 tokens vs 35 for JSON. Output tokens are the latency bottleneck.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection