Settings

Theme

Kalosm 0.3: A Rust framework for local AI

floneum.com

1 points by Evan-Almloff a year ago · 1 comment

Reader

Evan-AlmloffOP a year ago

Kalosm is a library for pre-trained text, audio and visual models in Rust. It includes support for:

- Whisper for audio transcription

- Llama, phi and mistral models for text generation.

- Structured generation: You can generate text that fits your specific format by deriving a parser automatically with structured generation

- Bert for text embedding and search

The latest release adds support for deriving parsers and json schemas to use with structured text generation, real time audio transcription and a bunch of performance improvements

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection