Settings

Theme

Incremental Context Testing for LLMs

slingingbits.com

2 points by awestley 8 months ago · 1 comment

Reader

awestleyOP 8 months ago

Wrote a small script to test how LLMs handle growing context sizes. It sends larger prompts step by step and measures slowdown or failure. Pretty rough but useful so far. Curious if others have ideas for improving it.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection