On-Device Acceleration of Large Diffusion Models
arxiv.org> Google LLC
Now we are talking. Stable Diffusion getting some assistance in on-device usage.
Won't be surprised to see Apple join in.
Apple ported SD to CoreML almost immediately, and pushed it to Github!
That being said, they havent really turned it into a product.
> That being said, they havent really turned it into a product.
I don't think they need to, since they are also AI shovel makers due to their Apple Silicon chips.
So I guess that they will push for on-device LLMs soon. Won't be surprising to see that on iPhones and Macs.