Ask HN: If you work at an enterprise, do you use Open Source LLM or GPT?
Question behind the question. I'm building a startup which offers "AI Compute Box", essentially Hardware loaded with a fine-tuned LLM model which will be deployed to enterprises.
I am looking to understand whether (a) enterprises install models on their own rack, (b) deploy on AWS/Azure cloud, (c) use private instances offered by offered by AWS or Azure Due to privacy issues, I would as a company only ever use a finetuned LLM. thanks for your response. would this be an open source fine-tuned?