FinOps for LLM – Leanroute Team wrote a blog
I found this is probably the simplest and realistic (no fluff) take on FinOps for LLMs. https://leanroute.dev/blog/finops-for-llm-spend-three-axes-of-cost-variance
1 thread
the part about lower spend not always meaning better optimization is pretty important, sometimes you just had less traffic lol
exactly, lost the user-base but kept thanking the code being more efficient lol