llms.py
Lightweight OpenAI compatible CLI, server gateway and OSS Open WebUI alternative for Local and Cloud LLMs
Quick Install
💬 Simple Chat
Ask questions directly from the command line
Run Server
💬 ChatGPT-like Interface
Modern, fast, and privacy-focused web UI for all your local and remote LLMs
What's New in v3
Major release focused on extensibility, expanded provider support, and enhanced user experience
530+ Models from 24 Providers
Powered by models.dev integration with automatic daily updates
Add features, providers, and customize the UI with flexible plugins
RAG workflows with document stores, categories, and contextual chat
First-class Python function calling for LLM interactions with your environment
Connect to Model Context Protocol servers for extended tool capabilities
Calculator & Run Code UIs
Beautiful UIs to evaluate math and execute Python, JS, TS & C# code
Browse and manage all your generated images and audio in one place
Built-in support for Gemini, OpenAI, OpenRouter, Chutes, and Nvidia
Beautiful LaTeX math typesetting for equations and formulas
Gemini File Search & RAG
Build knowledge bases with document stores and contextual AI chat
Runtime Provider Management
Enable or disable providers on the fly without configuration changes
Ready to Get Started?
Install llms.py and start chatting with 530+ AI models in minutes