LLM-in-a-Box: A Templated, Self-Hostable Framework for Generative AI

Together with www.linkedin.com/in/aaron-cul... I have created a template for making LLMs (from different vendors and even self hosted ones) easily accessible to researchers - including advanced document RAG with docling.

We are currently preparing a submission for JOSE and are looking for feedback but also more people who are interested in joining in and refining the template

top!