Settings

Theme

Stop using JSON for LLM structured output

nehmeailabs.com

2 points by 44za12 25 days ago · 1 comment

Reader

44za12OP 25 days ago

For simple extraction tasks, a delimiter-separated string uses 11 tokens vs 35 for JSON. Output tokens are the latency bottleneck.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection