Show HN: Agentpanel – Universal LLM API Written in Rust
github.comAgentpanel is an observability platform for optimizing the control flow, performance, token usage, and correctness of LLM/AI agents!
Built-in @rustlang, the first release of Agent Panel currently features an AI gateway that provides seamless access to 100+ LLMs across 20+ platforms, including OpenAI GPT-4o, Gemini 1.5 Pro latest, AnthropicAI Claude 3.5, MistralAI, Cohere, Groq,Perplexity AI, and more. Interesting! And it looks much sane compared to LangChain. Question: do almost all LLM APIs have the same roles "user", "assistant", and "system"? Thank you. Yes, almost all LLM APIs have the same roles. Let me know your thoughts once you try the project. Gemini models don't have "system" roles. gg stuff