Charlie Ruan (@charlie_ruan) on X

1 min read Original article ↗

With

@googlechrome

v121, you can run webllm.mlc.ai on your Android web browser with

@WebGPU

acceleration, everything locally! Here is a 1x speed demo of running 4-bit quantized Phi-2 on Samsung S23. Thank you

@quicksave2k@jason_mayes

for the support and suggestions!