Settings

Theme

Theater – a proposed runtime for LLM written code

github.com

2 points by colinrozzi 9 months ago · 3 comments

Reader

colinrozziOP 9 months ago

LLMs present incredible opportunities for software, but they also present significant challenges. It is realistic to assume that in the very near future significantly more software will be written, and much of it may have never seen human review. Because of this, many of the assumptions we have made in building the software ecosystem are no longer valid.

Traditional software distribution and running systems put a significant amount of trust on the programmer. Theater is attempting to build guarantees into the structure of the software system that hosts client applications. First, it uses WebAssembly Components to provide sandboxing and determinism. Then, we use the actor model with an erlang-style supervision system to provide isolation and fault-tolerance. Finally, for each of the actors that run in the system, we completely track any information that enters or leaves the wasm sandbox. If something in the system goes wrong, we should be able to trace it back through each actor, fixing whatever is needed along the way.

tantalor 9 months ago

"Why Theater " links to https://github.com/colinrozzi/theater/blob/main/docs/why-the...

This is a 404

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection