Settings

Theme

Seven Hours, Zero Internet, and Local AI Coding at 40k Feet

betweentheprompts.com

2 points by scastiel 4 months ago · 1 comment

Reader

NitpickLawyer 4 months ago

I don't know what ollama uses behind the scenes, but there's also MLX for macs, which should be faster in general. Also there's a thing about top_k on gpt-oss which might need tweaking. Saw reports that setting it to 100 vs. default 0 brings an extra ~20t/s in generation speed.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection