Show HN: Code to run Gemma2-2B on a Mac – a powerful model with GPT 3.5 perf
github.comI’ve used Gemma2-2B from GDM for a day, and it's a really solid model for its size from my experience. So I built a CLI app for a Mac.
More notes here: https://x.com/notnotrishi/status/1819085403728875557 I tried to let it add punctuations to a list of words from asr, but it changes the words no matter how I tweak the prompt.
lol. lol mind sharing an example? also in case you haven't already, can try with other models too by changing it from the code to see if they do better