Settings

Theme

WIP: Nvidia Parakeet ASR mode inference in GGML

github.com

2 points by jasonni · 1 comment

Reader

1 thread
jasonniOP

I'm working on implementing Nvidia's parakeet tdt ASR model inference in GGML framework. The performance result compared to the MLX python version surprised me. My ggml implementation is 1000x slower than the MLX python version. Any help/comments/suggestions are welcome. THanks a lot!

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection