Settings

Theme

Apple's Foundation Models can now use third-party LLMs (Claude, Gemini) [video]

developer.apple.com

2 points by nryoo 15 days ago · 1 comment

Reader

nryooOP 15 days ago

Text summary since it's a video: it's a model abstraction layer. You write against a LanguageModelSession, import a Swift package, initialize the model you want, and pass it to the session. Apple ships SystemLanguageModel (on-device), PrivateCloudComputeLanguageModel, and open-sourced CoreAILanguageModel and MLXLanguageModel for local models; Anthropic and Google are publishing their own packages.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection