are LLMs going to drive a swing back to on prem? i'm looking at $970/mo on AWS for the equivalent compute of my 16gb macbook seriously thinking of just buying two more macbooks and running omni from my living room

1 min read Original article ↗

Jan 29, 2024

For development, absolutely - but this has been true for a while, even at Google etc. Devs want beefy local machines for quick and dirty stuff. For production, less clear - though in general there is a reasonable pushback to cloud margins vs. long term capex planning and