SynapseKit โ€” Python LLM Framework

2 min read Original article โ†—

๐ŸŽ‰ v1.6.0 released โ€” 22 vector stores, 64 loaders, 34 LLM providers, SwarmAgent, RAPTOR & Agentic RAG, PluginRegistry. Changelog โ†’  |  ๐Ÿš€ EvalCI โ€” LLM quality gates on every PR, zero infra. Get started โ†’

Build RAG pipelines, AI agents, and graph workflows in Python.
27 providers ยท 41 tools ยท 18 loaders ยท async-native ยท streaming-first

$pip install synapsekit[openai]

Why SynapseKit

Built for production Python

Designed for engineers who want full control without writing everything from scratch.

โšก

Async-native

Every API is async/await first. No sync-first retrofit. Sync wrappers included for scripts and notebooks.

๐ŸŒŠ

Streaming-first

Token-level streaming is the default, not an afterthought. Works identically across all 27 LLM providers.

๐Ÿชถ

2 hard dependencies

numpy and rank-bm25 only. Every other capability is behind an optional extra. Install what you need.

๐Ÿ”Œ

One interface

27 LLM providers and 5 vector stores behind the same API. Swap providers without rewriting a single line.

๐Ÿ’ฐ

Cost intelligence

CostTracker and BudgetGuard give you full cost visibility and circuit-breaker budget limits โ€” no SaaS required.

๐Ÿš€

One-command deploy

`synapsekit serve my_app:rag` wraps any RAG pipeline, agent, or graph in a production FastAPI app instantly.

๐Ÿงฉ

Fully composable

RAG pipelines, agents, and graph nodes are interchangeable. Wrap anything as anything.

๐Ÿ”

No magic

No hidden chains, no callbacks, no global state. Every step is plain Python you can read and override.

27 LLM Providers ยท 41 Built-in Tools ยท 18 Loaders ยท 1,452 Tests Passing ยท Apache 2.0

Explore the docs

Everything you need

From a 3-line quickstart to production graph workflows.

Retrieval-augmented generation with streaming, BM25 reranking, conversation memory, and token tracing.

Read docs โ†’

ReAct loop for any LLM. Native function calling for OpenAI, Anthropic, Gemini, and Mistral. 41 built-in tools, fully extensible.

Read docs โ†’

DAG-based async pipelines. Parallel execution, conditional routing, typed state, fan-out/fan-in, SSE streaming, event callbacks, human-in-the-loop.

Read docs โ†’

OpenAI, Anthropic, Ollama, Gemini, Cohere, Mistral, Bedrock, Azure, Groq, DeepSeek, OpenRouter, Together, Fireworks, SambaNova and more โ€” 27 providers behind one interface.

Read docs โ†’

`synapsekit serve` deploys any pipeline in one command. `synapsekit test` runs eval cases with scoring thresholds in CI.

Read docs โ†’

CostTracker, BudgetGuard, TokenTracer, OpenTelemetry export, and DistributedTracer โ€” full visibility without a SaaS subscription.

Read docs โ†’

InMemory, ChromaDB, FAISS, Qdrant, Pinecone. One interface for all backends. Swap without rewriting.

Read docs โ†’

Complete reference for every public class and method in SynapseKit.

Read docs โ†’