Settings

Theme

LLM-cpp: 26 single-header C++17 libraries for LLM integration

github.com

3 points by Shmungus 5 months ago · 3 comments

Reader

ShmungusOP 5 months ago

Built this over a weekend because every C++ project I worked on needed LLM features and the options were either "wrap the Python SDK somehow" or "write the curl SSE parsing yourself again."

26 libraries across four categories — Core, Data, Ops, App. Each one is a single .hpp file. Drop in what you need, define one implementation macro, ship. No Python runtime, no package manager, no build system changes beyond linking libcurl where needed.

llm-stream has 83 unique clones already with zero promotion. Figured the rest of the suite was ready to share. Happy to answer questions on design decisions, the single-header pattern, or anything else.

mondainx 5 months ago

Very cool, thanks for sharing. I'm sure this will come in handy!

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection