Ask HN: Rather than Gemini Nano, what's the best way to run an LLM in-browser?
I would like to my javascript app to have local access to a basic LLM.
In the next version of Chrome Google says that Gemini Nano will be included, thanks to the advances in WebAssembly. But it's surely going to be awhile (if ever) before other major browsers choose to integrate Gemini Nano.
Since WebAssembly is widely supported, has anyone experimented with LLMs that can run in-browser? Ideally, one that can even run on mobile Safari/Chrome?
No comments yet.