Settings

Theme

How do you run System One decision models locally?

stackness.dev

2 points by gosen · 1 comment

Reader

1 thread
gosenOP

To run a System One model locally you pick a runtime as well as a model. Ollaya serves ten open decision models behind a Jev-compatible API, laya-mlx runs Laya on Apple silicon, and llama.cpp needs a shim. Which numbers are measured, and when hosted Jev still wins.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection