Show HN: Xecai, a minimal Python interface for LLM providers for RAG systems
github.comA small python library to simplify LLM calls, database retrieval, reranking, conversation storage & embeddings when building RAG systems.
The library intentionally exposes only the functionality common across providers to avoid provider-specific parameters.
Libraries like LangChain provide many integrations but often rely on many abstractions, heavy use of kwargs, and complex code that can be difficult to customize.
Features: - Sync and async APIs - LLM calls: invoke and stream (temperature, reasoning level) - Response metadata: answer, token usage, stop reason - RAG documents: retrieval, reranking, embeddings - Chat history: conversation store - Common error handling across providers - Providers: OpenAI, Anthropic, Google, AWS
Retry logic is left to the user (see README). Agent functionality is not supported yet.
No comments yet.