With @googlechrome v121, you can run https://t.co/Tt9Tv62q96 on your Android web browser with @WebGPU acceleration, everything locally! Here is a 1x speed demo of running 4-bit quantized Phi-2 on Samsung S23. Thank you @quicksave2k @jason_mayes for the support and suggestions! https://t.co/ixvSJMbg93

With

v121, you can run webllm.mlc.ai on your Android web browser with

acceleration, everything locally! Here is a 1x speed demo of running 4-bit quantized Phi-2 on Samsung S23. Thank you

for the support and suggestions!

3:58 PM · Jan 24, 202442.8KViews