Settings

Theme

AI Agent Security Lecture

github.com

4 points by anishathalye 2 months ago · 4 comments

Reader

anishathalyeOP 2 months ago

I recently gave a guest lecture on AI Agent Security in MIT's 6.566 class (a survey course on computer systems security). We covered:

- Foundations of LLMs, from next-token prediction to conversational chat and tool use - Foundations of agents, including ReAct and CodeAct - AI agent security - Simon Willison's dual LLM pattern - CaMeL's capability system

The GitHub repo has lecture notes plus code demos for all the concepts covered (in my opinion, code makes things really concrete, and writing the code helped me better understand Dual LLM and CaMeL). The full lecture is on YouTube: https://www.youtube.com/watch?v=w0oGeKxD5Fc.

vishnukool 2 months ago

Good one. One thing that's becoming clear is that agent security is less about jail break prompts and more about permission boundries, hidden context flow and un intended tol behavior.

0c33 2 months ago

great

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection