Settings

Theme

Show HN: An open-source alternative to OpenAI function calling

outlines-dev.github.io

4 points by btwillard 2 years ago · 1 comment

Reader

btwillardOP 2 years ago

OpenAI function calling provides a means of producing valid JSON from a function signature, or a simplified version of a JSON schema definition; however, it has two big downsides:

1. it doesn't work with open-source models, and 2. sometimes the JSON it produces will not even parse.

A similar interface was recently merged into our open-source project Outlines. The approach can be extended to any open-source model and it can guarantee that the output will be parsable JSON.

Constructive feedback, bug reports, feature requests, and questions are greatly appreciated!

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection